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This  mathematical  study  of  buffering  and  flow  control  is 
based  on  a gradual  input  queueing  model.  The  gradual  input 
model  has  been  used  previously  to  study  data  multiplexors. 
Here  it  is  extended  to  an  entire  message  switched  communica- 
tion network . 


A probability  of  buffer  overflow  analysis  is  developed 
and  used  to  determine  buffer  requirements.  A delay  analysis 
is  also  developed.  The  results  obtained  using  the  gradual 
input  queue  are  compared  to  the  commonly  used  ll/M/l  queue 
model  for  message  switched  networks.  The  gradual  input  model 
allows  one  to  observe  several  effects  due  to  a finite  number 
of  finite  rate  traffic  sources  in  such  networks  that  cannot 
be  observed  using  the  M/M/1  model. 

Flow  control  is  studied  in  tree  concentration  structvires 
The  flow  control  assures  that  buffer  overflows  will  oequr 
only  at  source  nodes,  not  in  the  Interior  of  the  tree.  The 
problem  of  finding  the  buffer  allocation  that  minimizes  the 
probability  of  buffer  overflow  in  such  a tree  is  studied. 

It  is  shown  that  in  certain  cases  it  is  optimal  to  place 
all  buffers  at  source  nodes.  This  is,  however,  not  always 
so  and  insight  into  this  is  given  by  example. 

Determining  the  performance  of  a tree  struetvire  in  which 
flow  control  is  being  used  is  a difficult  analytic  problem. 

An  approximate  analysis  based  on  a first  passage  time  theorem 
for  Markov  chains  is  therefore  developed  for  an  example. 

The  approximate  analysis  is  verified  by  simulation. 
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CHAPTER  I - INTRODUCTION 

1,1  Description  of  the  Problem 

Message  switched  communication  networks  are  moving 
quickly  into  prominence  as  effective  networks  for  data 
communication.  Much  of  the  current  interest  in  message 
switched  networks  has  resulted  from  the  experience  of  the 
Advanced  Research  Projects  Agency  Network  (ARPANET) . 

ARPANET  demonstrated  that  a message  switched  network  in 
which  messages  are  sent  as  one  or  more  packets  can  be  an 
appropriate  design  choice  for  providing  communications  for 
computers  [RBRTS  10,  KAEN  72].  There  are  also  a number  of 
other  packet  switched  networks  which  currently  exist  or  are 
under  development.  These  include  the  Cyclade  Network 
[POUZ  74] , the  Transpac  Network  [DANET  76] , the  commercial 
network  Telenet  and  the  military  network  Autodin  [ROSN  73] . 

An  important  characteristic  of  message  switched  networks 
for  data  communication  is  that  they  can  contain  buffers. 
Buffers  allow  the  network  to  accept  temporarily  traffic  from 
sotirces  at  a rate  greater  than  the  rate  at  which  it  is  being 
delivered  to  the  destinations.  Since  buffers  have  finite  ■ 
capacity,  message  switched  networks  require  flow  control 
mechanisms  to  control  the  traffic  sources  in  order  to 
prevent  buffer  overflow  and  other  congestion  problems  (such 
as  lock  up  problems  or  unacceptably  high  delay) . 


This  study  deals  with  the  mathematical  modeling  and 
analysis  of  such  buffering  and  flow  control  in  message 
switched  networks.  The  work  presented  here  consists  of  two 
major  parts. 

1)  A gradual  input  queue  model  is  developed  and  used 
to  investigate  the  theoretical  buffer  requirements 
of  a class  of  message  switched  networks. 

2)  The  problem  of  optimal  buffer  allocation  and  flow 
control  is  investigated  for  tree  concentration 
structures  within  such  networks. 

The  message  switched  networks  considered  in  this  study 
are  of  the  general  type  shown  in  Figure  1.1.  The  networks 
consist  of  sources  and  destinations  interconnected  by 
directed  communication  channels  through  buffered  message 
switching  nodes.  Some  of  the  nodes  are  connected  in  con- 
centrating tree  structures.  The  tree  structures  are  then 
interconnected  with  each  other  by  a network  whose  structure 
is  not  restricted.  In  this  general  class  of  network 
struct\ires,  the  trees  are  the  "local  distribution"  part  of 
the  network  while  the  network  interconnecting  the  trees  is 
the  "long  distance"  network.  Since  tree  structures  are  less 
difficult  to  analyze  than  general  networks,  particular 
emphasis  is  placed  on  them  in  this  study.  They  are  the 
only  structures  in  which  flow  control  is  studied.  This 
emphasis  is  also  supported  by  the  fact  that  the  "local 
distribution"  costs  are  a very  significant  part  of  the  total 
cost  of  a message  switched  network. 
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GENERAL  INTERCONNECTION 
NETWORK 


FIGURE 


CONCENTRATION  TREE 
STRUCTURE  (CT) 


Message  Switching  Node 

^ ■ Directed  Commiini cation  Channel 


1»1  “ General  class  of  message  switched  networks 
studied 


An  enlarged  view  of  a message  switching  node  is  shown 


\ 

in  Figure  1.2a.  Traffic  arrives  at  a node  over  input 
channels  as  an  on/off  process.  The  rate  of  arrival  of  the 
individual  bits  in  a message  is  determined  by  the  input 
channel  capacity  or  source  rate  and  messages  arrive  in  a 
gradual,  flow  like  manner.  The  switch  sends  messages  to  the 
correct  output  channel  according  to  a fixed  routing  policy. 

The  switch  is  assumed  to  operate  instantaneously  and  in  a 
continuous  flow  fashion.  The  continuous  flow  through  the 
switch  means  that  if  there  is  no  contention  for  an  output 
channel,  there  will  be  no  delay  in  passing  through  a node. 

Thus  the  node  does  not  operate  in  a store  and  forward  memner, 
in  which  a complete  message  must  be  received  at  a node  before 
any  of  it  is  sent  on  the  output  channel. 

The  model  thus  can  be  used  to  obtain  the  theoretical 
buffer  requirements  due  only  to  contention  for  communication 
chaiuiels  of  finite  capacity  (i.e.  those  buffer  requirements 
not  due  to  the  nature  of  store  and  forward  operation,  finite 
switching  rates,  or  the  need  to  store  messages  until  error 
detection/retransmission  or  error  correction  is  complete.) 

While  this  study  .deals  with  a flow-through  network,  many  of 
the  Insights  obtained  are  applicable  to  store  and  forv/ard 
' networks  as  well. 

The  study  assumes  that  buffers  in  the  nodes  are  associated 

i 

with  only  one  output  channel.  This  is  not  as  efficient  as  one 
shared  buffer  pool  for  all  output  lines,  but  serves  to  make 
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the  mathematical  analysis  feasible.  The  division  of  buffer 
capacity  in  a node  can  also  be  supported  by  the  fact  that  in 
actual  systems,  each  output  channel  might  have  a dedicated 
communications  processor  with  its  own  buffer. 

As  a result  of  the  assumed  buffer  division  and  switch 
operation,  each  buffer  is  as  shown  in  Figure  1.2b.  Each 
buffer  is  fed  by  several  input  channels  with  on/off  traffic 
and  this  produces  in  turn  an  on/off  traffic  pattern  on  the 
output  channel.  The  stochastic  model  of  this  buffer  is 
called  a gradual  input  queue.  It  has  been  studied  by  Cohen, 
Rubinovitch  and  Kaspi  [COHEN  74,  RUBIN  73,  KASPI  75]  and  it 
is  the  basic  model  that  is  used  in  this  study. 

Previously,  the  gradual  input  queue  model  has  been 
analyzed  for  networks  of  converging  tree  structures  with 
infinite  buffers  at  each  node.  The  first  major  part  of 
this  study  extends  this  model  to  general  networks  using  a 
fixed  routing  policy  for  messages  and  no  blocking  or  flow 
control  between  nodes.  The  extension  also  includes  overflow 
measxires  such  as  a probability  of  overflow  for  finite 
buffers  in  such  networks. 

In  a message,  switched  network  it  is  desirable  to  have 
flow  control  measures  that  can  relieve  congestion  at  a 
communication  channel  by  reducing  the  rate  of  inflow  to 
that  channel.  To  analyze  even  simple  flow  control  policies 
for  general  networks  is  extremely  difficult.  Therefore, 
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this  study  considers  flow  control  only  in  converging  tree 
structures.  The  second  major  part  of  this  study  investigates 
the  optimal  buffer  allocation  and  flow  control  for  such 
structures.  The  flow  control  considered  involves  flow  rules 
that  do  not  allow  buffer  overflows  in  the  interior  of  the 
tree  structure.  Therefore,  all  overflows  occur  at  source 
nodes  where  it  would  presumably  be  straightforward  to  turn 
off  sources  to  avoid  lost  traffic. 

In  recent  years  there  has  been  considerable  interest  in 
the  analysis  of  message  switched  networks,  flow  control  and 
related  queueing  problems.  A survey  of  previous  studies  in 
these  areas,  discussed  from  the  viewpoint  of  their  relation 
to- this  study,  is  given  in  the  next  section. 

1.2  Previous  Studies  of  Buffering  and  Flow  Control 

An  early  analytic  study  of  the  queueing  processes  that 
occur  in  the  buffers  of  message  switched  communication  net- 
works was  done  by  Kleinrock  [KLEIN  64] . Kleinrock  modeled 
buffered  communication  channels  as  exponential  service  time 
(message  transmission  time)  queues  with  Poisson  input  streams 
of  messages  and  infinite  buffers  (i.e.  M/M/1  queues).  A 
coBonunication  network  is  then  represented  by  a network  of 
stich  queues.  On  the  basis  of  the  result  that  the  output 
process  of  an  M/M/1  queue  is  Poisson  (BURKE  56] , Kleinrock 
argued  that  each  queue  in  the  network  could  be  analyzed  by 
merely  determining  the  mean  arrival  rate  into  it.  Each 
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qu«u«  in  the  network  behaves  the  same  as  a single  M/M/1  queue 
not  in  a network.  This  has  been  formalized  by  Jackson  [JACK 
57].  Jackson  showed  that  for  certain  networks  of  queues,  the 
steady  state  joint  distribution  for  the  number  of  customers 
at  each  queue  has  a product  form.  Each  term  in  the  product 
is  the  same  as  the  distribution  for  an  independent  queue  with 
the  appropriate  mean  arrival  rate.  Using  the  network  of 
queues  model,  Kleinrjck  considered  a number  of  network 
design  problems,  including  finding  the  communication  chamnel 
capacity  allocation  which  minimizes  the  expected  delay 
through  the  network  subject  to  a total  network  cost  constraint. 
While  buffer  occupancy  statistics  were  not  explicitly  con- 
sidered in  this  study,  it  is  straight  forward  to  obtain 
the  steady  state  results  using  the  network  of  queues  model. 

It  is  important  to  examine  the  assumptions  that  were 
required  to  make  the  network  of  queues  model  mathematically 
tractable.  The  main  assumption  is  that  if  a message  passes 
through  more  than  one  communication  channel,  its  length 
(service  time)  is  chosen  independently  at  each  queue  (channel) 
through  which  it  passes.  This  independence  assrsnption  is 
necessary  to  remove  the  statistical  dependence  between  the 
interarrival  times  and  message  lengths  of  adjacent  messages 
in  the  network.  A second  assumption  is  that  at  the  time  of 
a message  arrival,  all  of  the  information  bits  associated 
with  that  message  arrive  instantaneously  at  the  channel 
buffer.  Clearly,  if  the  communication  channels  have  fi-ita 
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capacity#  the  Information  bits  arrive  gradually,  not 
' instantaneously.  The  gradxial  input  queueing  models  to  be 
used  in  this  study  do  not  use  either  of  these  assxunptions. 

Sone  assus^tions  will  have  to  be  made#  however#  for  the 
gradual  input  model  as  well  and  they  have  some  relation  to 
the  independence  assumption  used  by  Kleinrock.  In  particular# 
the  gradual  input  queue  analysis  requires  that  the  statistics 
of  all  input  channels  be  Independent.  If  in  a general  net- 
work# traffic  with  a common  destination  is  routed  over  two 

I 

j paths  that  share  some  channels#  separate  and  then  again  share 

some  channels#  this  will  require  a type  of  Independence 
I assxanptlon.  The  independence  assumption  is#  however#  not 

made  for  directly  adjacent  nodes. 

A network  of  queues  model  has  recently  been  used  by  Lam 
(LAM  76]  to  study  the  buffer  requirements  in  a packet 


switched  network  when  each  node  of  the  network  has  only  a 

% 

finite  storage  capacity.  The  network  is  assumed  to  operate 


on  a store  and  forward  basis  with  link  by  link  acknowledge- 
ment of  messages.  Using  basically  the  same  assumptions  as 
Kleinrock  in  a more  complex  model#  Lam  obtains  approximate 
results  for  the  probability  of  nodal  blocking-  due  to  buffer 
overflow.  The  study  also  develops  a heuristic  algorithm  for 
detemining  a balanced  assignment  of  buffer  capacities  in 
the  network. 


^ Another  study  of  the  queueing  processes  in  networks  of 
length  queues  representing  message  switched  communica- 
tion networks  has  been  done  by  Borgonovo  and  Fratta  (BORG  73]. 
This  study  approached  the  problem  by  using  an  exact  Markoviem 
•tate  space  model  to  represent  the  dynamic  operation  of  the 
network.  Such  a model  is  feasible  only  for  very  small  net- 
«rorks  with  few  buffers  because  the  size  of  the  state  space 
grows  extremely  rapidly  as  the  size  of  the  network  increases. 
To  overcome  this  problem,  heuristic  upper  and  lower  boxinds 
were  developed  for  the  probability  of  nodal  blocking  due  to 
buffer  overflow  for  symmetric  ring  networks.  Borgonovo  and 
Fratta  overcame  the  independence  assvimption  by  working  in 
discrete  time  with  fixed  length  messages. 

In  addition  to  the  eibove  studies  of  complete  networks, 
there  have  been  numerous  studies  of  the  queueing  processes 
associated  with  just  one  communication  channel  or  one  node  of 
a message  switched  network  [HSU  73,  HSU  74,  PACK  74,  CHU  70A, 
CHU  70B,  GORD  70,  RUDIN  70,  CHU  73,  RICH  75,  CHU  69,  IRLND  75, 
HYNER  74] . Most  Of  the  studies  assume  that  messages  arrive  as 
a Poisson  process  in  an  instantaneous  manner.  A study  which 
does  not  make  this  assumption  has  been  done  by  Gordon, 

Meltzer  and  Pile  [GORO  70] . This  study  investigates  the 
operation  of  a statistical  multiplexor  for  message  switched 
traffic  that  comes  from  a finite  number  of  two  state  Markov 
sources  by  simulation.  The  sources  are  either  in  the  on 
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state  or  in  the  off  state  and  in  the  on  state  they  generate 
a steady  stream  of  characters  at  a finite  rate.  This  is 
much  like  the  source  model  that  will  be  used  in  this  study  of 
the  gradual  input  queue.  The  Gordon  study  gives  the  buffer 
capacities  needed  to  meet  certain  probability  of  buffer 
overflow  requirements.  The  average  character  delay  through 
the  buffer  was  also  obtained. 

Flow  control  in  a message  switched  network  designed  for 
computer-communication  became  a topic  of  interest  during  the 
design  and  subsequent  operation  of  the  ARPANET.  The  flow 
control  mechanisms  used  in  the  ARPANET  are  discussed  by 
Kahn  and  Crowther  [KAHN  72] . Two  basic  mechanisms  are  used, 
one  for  source  to  destination  flow  control  and  one  for  node 
to  node  flow  control. 

The  source  to  destination  flow  control  is  achieved  by 
defining  a link  to  be  a unidirectional  logical  connection 
between  users  of  the  network  and  then  controlling  the  number 
of  messages  outstanding  on  a link  at  any  one  time.  In 
ARPANET,  the  rule  used  is  that  there  can  be  only  one  message 
outstanding  on  a link  at  a time.  This  rule  is  enforced  by- 
sending  a ”reques.t  for  next  message"  (RPNM).  from  the  destina- 
tion to  the  source  after  each  message  is. received.  The 
source  does  not  send  the  next  message  until  it  receives  the 
RFNM. 
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Th«  node  to  node  flow  control  in  ARPANET  is  based  on  a 
system  of  acknowledgement  messages  (ACKS).  After  a node 
sends  a message  to  the  next  node*  it  keeps  a copy  of  the 
message  until  it  receives  an  ACK  for  that  message  from  the 
receiving  node.  Therefore*  if  the  receiving  node  has  no 
buffer  space  available*  it  can  simply  discard  an  incoming 
message  and  not  send  an  ACK  for  that  message.  Then*  after 
waiting  a specified  length  of  time  and  not  receiving  an  ACK* 
the  sending  node  will  retransmit  the  message. 

Both  the  source  to  destination  emd  the  node  to  node  flow 
control  serve  to  effectively  control  congestion  in  many 
circximstances . In  some  situations*  however*  these  mechanisms 
can  lead  to  lockup  conditions  or  otherwise  reduce  network 
throughput.  The  avoidance  of  such  lockup  conditions  and 
reduced  throughput  has  led  to  modification  of  the  specific 
flow  control  rules  for  ARPANET.  The  basic  concepts  still 
apply*  however. 

There  is  only  a limited  eunount  of  theoretical  literature 
on  flow  control.  One  scheme  that  has  been  proposed  and 
analyzed  to  some  extent  is  isarithmic  flow  control.  Isarith- 
mic  flow  control  was  first  described  by  Davies  [DAV  721 • The 
basic  idea  is  to  have  a fixed  number  of  message  carriers  that 
are  used  to  send  messages  through  the  network.  An  input 
message  must  wait  for  a carrier  to  be  available  at  the  input 
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nod*  b«for*  it  can  progress  through  the  network.  When  a 
carrier  is  empty,  it  circulates  at  random  through  the  network 
until  it  arrives  at  a node  that  has  traffic  for  it. 


The  main  parameter  associated  with  isarithmic  flow 
control  is  the  number  of  message  carriers  in  the  network. 

Davies  has  shown  by  simulation  that  throughput  is  a function 

of  the  number  of  carriers.  If  there  are  too  few  carriers, 

traffic  is  naedlessl  rejected  at  the  inputs,  while  if  there  I 

are  too  many  carriers,  congestion  occurs.  Davies  points  out  | 

I 

that  isarithmic  flow  control  is  not  designed  to  completely 

replace  other  flow  control  mechanisms.  In  addition  to  the  ^ 

simulation  study,  Sencer  (SENCER  74]  has  developed  an  analytic  ^ 

J 

queueing  model  for  isarithmic  flow  control.  | 

The  analytic  evaluation  of  flow  control  mechanisms  is  in 
general  very  difficult.  Recognizing  this,  Chou  and  Gerla 
[CHOU  75]  have  proposed  a framework  in  which  to  classify  and 
then  develop  simulation  models  for  such  mechanisms.  Their 
scheme,  called  the  unified  flow  control  model,  recognizes 
that  messages  are  allowed  to  enter  a network  or  proceed 
through  it  only  if  1)  in  some  sense  the  buffers  required 
have  been  allocated  at  the  point  of  entry  and/or  if  2)  the  ] 

number  of  occupied  buffers  is  below  some  threshold.  Various  ‘ 

flow  control  mechanisms  differ  in  the  rules  for  allocation  j 

and  in  the  thresholds  that  are  defined.  Once  these  rules 
have  been  identified  for  a given  mechanism,  it  can  be 
simulated  in  the  framework  of  the  unified  flow  control  "odel. 
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Some  reference  to  a flow  control  scheme  that  is  similar 
to  the  rate  flow  control  consider  in  this  study  has  been 
made  in  a survey  by  Gerla  and  Chou  [GERLA  74] . The  survey  I 

f 

mentions  a proposed  flow  control  strategy  due  to  Pouzin 
that  controls  input  rates  on  the  basis  of  the  information  in 
flow  control  tables  which  are  circulated  in  the  network.  The 
flow  control  considered  in  this  study  also  controls  flow  rates. 
Extensive  flow  control  tables  are.  however,  not  needed  in  this 
study  since  it  is  limited  to  concentration  tree  structures. 

In  such  structures  flow  control  can  consist  of  simply  reducing 
the  flow  rate  of  upstream  nodes  whenever  downstream  nodes 
become  congested.  The  flow  control  problem  for  a general 
network  is  much  more  complicated  and  Pouzin  ha.'  apparently 
not  analyzed  his  proposed  scheme  mathematically. 

1,3  Summary  of  Results 

A single  gradual  input  queue  is  first  considered  in 
detail  since  it  is  the  basis  of  this  study.  Chapter  2 
presents  the  previously  known  results  for  this  model  and  a 
number  of  extensions.  An  important  extension  required  for' 
this  study  is  a probability  of  overflow  measure  for  a queue 
with  a finite  buffer.  The  probability  of  overflow  per  busy 
period  is  found  and  a useful  exponential  upper  bound  for  it 
i*  else  obtained.  It  is  shown  how  this  overflow  measure  can 
be  converted  to  an  expected  time  between  overflows.  Other 
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overflow  measures  are  also  discussed.  A final  extension  for 
the  single  queue  is  the  development  of  upper  and  lower  bounds 
for  the  expected  delay  per  bit  through  the  buffer. 

In  previous  buffering  studies  of  message  switched  net- 
works the  M/M/1  queue  model  has  been  extensively  used.  The 
gradual  input  model  is  therefore  compared  to  the  M/M/1  model. 
Such  a comparison  for  single  queues  is  presented  at  the  end 
of  Chapter  2.  It  is  shown  that  the  gradual  input  model 
enables  one  to  see  effects  due  to  a finite  number  of  finite 
rate  traffic  sources  that  are  not  apparent  with  the  M/M/1 
model.  All  of  these  effects  reduce  the  eunount  of  queueing 
from  that  calculated  with  the  M/M/1  model. 

The  analysis  of  a network  of  gradual  input  queues  is 
presented  in  Chapter  3.  It  is  first  shown  that  all  traffic 
streams  in  a general  network  are  not  exactly  of  the  type 
required  for  the  analysis  presented  in  Chapter  2.  Specifically, 
*11  traffic  streams  will  not  be  alternating  renewal  processes 
with  exponential  off  times  even  if  the  source  traffic  streams  are 
of  this  type.  It  is  shown,  however,  that  if  source  streams 
have  both  exponential  on  and  off  times  it  is  a good  approxi- 
mation to  assume  that  all  traffic  streams  in  the  network  are 
of  this  type.  This  is  verified  mathematically  for  two 
limiting  cases  and  by  simulation. 
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The  analysis  of  a general  network  of  gradual  input  queues 
is  then  done  by  first  calculating  the  mean  on  and  off  times 
associated  with  all  traffic  streams.  Two  sets  of  linear 
equations  are  developed  for  this  purpose.  Once  the  mean 
traffic  parameters  have  been  found,  the  analysis  presented 
in  Chapter  2 can  be  applied  to  obtain  marginal  statistics 
for  each  buffer  in  the  network. 

The  results  for  networks  of  gradual  input  queues  are 
also  compared  with  those  obtained  using  a network  of  M/M/1 
queues.  Again  the  finite  source  nature  of  the  gradual  input 
model  shows  network  effects  that  cannot  be  seen  with  the 
M/M/1  model . 

Plow  control  is  investigated  for  tree  concentration 
structures.  The  flow  control  is  used  to  eliminate  overflows 
in  the  interior  of  the  tree.  Therefore  all  overflows  occur 
at  source  nodes  where  it  would  presumably  be  easy  to  turn  off 
the  sources.  The  first  problem  considered  is  finding  the 
buffer  allocation  in  such  a tree  that  minimizes  the  probability 
of  buffer  overflow.  It  is  shown  that  in  certain  cases, 
placing  all  buffers  at  source  nodes  is  the  desired  allocation. 
This  is  not  a general  result,  however.  A counterexample  is 
presented  that  gives  insight  into  why  it  is  not  always 
desirable  to  place  all  buffers  at  source  nodes. 


Even  though  reasonable  flow  control  rules  can  sometimes 
be  specified,  it  is  often  difficult  to  analyze  the  performance 
of  the  resulting  system.  To  help  deal  with  this  problem,  an 
approximate  analysis  of  a small  concentration  tree  using  flow 
control  is  presented.  The  analysis  is  based  on  a first 
passage  time  theorem  for  Markov  chains.  The  theorem  states 
that  the  tail  behavior  of  first  passage  time  distributions 
is  geometric  or  exponential  under  fairly  general  conditions. 
This  is  used  to  develop  a stage  by  stage  analysis  of  a three 
node  system  by  coupling  the  dynamics  of  the  nodes  in  an 
approximate  way.  The  results  obtained  in  this  way  for  the 
system  probability  of  overflow  are  verified  by  simulation. 
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CHAPTER  II  - THE  ANALYSIS  OF  A SINGLE  GRADUAL  INPUT  QUEUE 
Before  considering  the  analysis  of  an  entire  message 
switched  network,  it  is  necessary  to  analyze  a single  gradual 
input  queue.  The  first  section  of  this  chapter  presents  the 
basic  definitions  and  results  for  the  gradual  input  queueing 
model  due  to  Rubinovitch,  Cohen  and  Kaspi.  In  addition, 
results  for  specific  cases  of  interest  in  this  study  are 
obtained  and  a delay  analysis  for  the  queue  is  developed. 

The  next  section  considers  overflow  statistics  for  a gradual 
input  queue  with  a finite  buffer.  The  final  section  compares 
the  gradual  input  queue  with  the  simpler  M/M/1  queue  in  order 
to  show  the  insights  obtainable  from  the  more  detailed  model. 


2.1  The  Basic  Gradual  Input  Queue  Model 

2.1.1  Definitions  and  previous  results 

The  following  description  of  the  gradual  input  queue 
parallels  that  of  Cohen  [COHEN  74].  The  model  represents  N 
Incoming  channels  being  multiplexed  onto  a single  outgoing 
channel  as  is  shown  in  Figure  2.1a.  The  capacity  of  each  of 
the  iiicoming  channels  is  the  same  as  that  of  the  outgoing 
channel,  so  that  when  only  one  Incoming. channel  is  on,  data 
passes  directly  through  the  multiplexor  without  buffering  or 
delay.  When  more  than  one  incoming  channel  is  on,  a queue 
builds  up.  The  buffer  is  assumed  to  have  infinite  capacity 
and  is  shared  by  all  incoming  channels.  The  outgoing  channel 


pmndM  data  at  a constant  rate  whenever  any  incoming  channel 

is  on  or  there  is  data  in  the  buffer. 

The  on  and  off  process  associated  with  each  incoming 

channel  is  taken  to  be  an  alternating  renewal  process . As 

shown  in  Figure  2.1b/  for  the  ith  channel  this  process  is 

described  by  the  sequence  °2,i*  "^2,1  ••• 

j statistically  independent  nonnegative  random  variables.  The 

random  variables  (n  • 1/2/3...)  represent  the  successive 

idle  periods  on  the  ith  ch2Uinel  and  the  random  variables 

* 1/2/3...)  represent  the  lengths  of  the  successive 

busy  periods  on  that  channel.  The  random  variables  o . have 

n/i 

distribution  A(‘)  while  the  random  variables  t . have  distri- 

I 

bution  BC*).  The  restriction  that  the  processes  on  all  input 
channels  be  identically  distributed  will  be  removed  later. 

Figure  2.2  shows  the  behavior  of  the  gradual  input 
buffer  for  a specific  sample  function  of  the  input.  A 

I 

period  of  continuous  inflow  into  the  buffer  is  called  an 
inflow  period  and  its  length  is  denoted  by  . The  sum  of 
i the  lengths  of  all  messages  flowing  into  the  buffer  during 

I the  jth  inflow  period  is  called  the .load  hj.  A busy  period 

buffer  is  a period  of  uninterrupted  flow  on  the  output 
channel.  Its  length  is  denoted  by  b.  The  length  of  time 

' 1 

i between  the  start  of  successive  busy  periods  is  called  a 

I busy  cycle,  whose  length  is  denoted  by  c.  The  length  of  time 

between  the  end  of  the  nth  and  the  beginning  of  the  (n-^Dst 

. i 

1 
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inflow  periods  is  denoted  by  a final  quantity  defined 

by  Figure  2.2  is  the  content  of  the  buffer  at  the  start  of 

the  nth  inflow  period,  denoted  w , 

— — 22 

Zn  order  to  facilitate  the  Analysis  of  the  gradual 
input  queue,  it  is  necessary  to  restrict  the  distribution  of 
off  times  on  the  input  channels  to  be  exponential,  i.e. 

A(t)  ■ 1-e”^^  ; t > 0,  X > 0 

0 ; t - 0 

With  this  restriction,  the  gaps  between  inflow  periods,  fi, 
are  also  exponentially  distributed  (with  mean  (NX)”^).  Prom 
Figure  2.2  it  can  be  seen  that  the  relationship  between 
successive  buffer  contents  w^  is  given  by 

'^n+l  " ^''n**'*'n"^n"^n+l^  n-l,2,3...t 

Since  the  6^^  are  exponentially  distributed,  the  random 
variables  correspond  to  the  actual  waiting  times  of  an 
K/O/l  queue  with  service  times  and  interarrival  times 

«n*  waiting  time  in  the  li/G/1  queue  is  the  time 

between  the  arrival  of  a customer  and  the  start  of  his 
service.  This  equivalence  is  the  basis  of  the  analysis  of 
the  gradual  input  queue. 

t [x]*^  « X if.  X > 0 
0 if  X - 0 

27 


Zn  ord«r  to  naJc*  uso  of  th«  Jcnown  roaulta  for  th«  H/G/1 
qoouo  in  analyzing  tha  gradual  input  quaua,  it  ia  nacaasary 
to  obtain  tha  diatribution  of  Thia  haa  baan  dona  by 

Cohan.  Tha  cantral  raault  ia  givan  balow.  Oafina 

B*(p)  ■ /*a***^  dB(t)  Ra  p - 0 

0 

8 ■ /*t  dB(t) 

0 

A • NA  a • AS 

Thaoran  (Thaoram  2.3  [COHEN  74]) 

For  Bap-0,  Raa>0,  t>0rRau>0 
a+ACl-ECaacpC-ph-al)  })*^  ■ 

f*'**  'OT  \ 5tTn-g»'lp°u)  >>”  • 

/g  u^^a’*^  {1-B*(p+U)}du)  dt;  N—  . 

(Bq.2.1) 

Zn  thia  thaoram,  Nm  ia  tha  caaa  aa  N-»«,  A-«>0.  Tha 
intagral 

/c  F(u)du  s lim 

''tt  C-Mi 


ic-^Rau 

/ 

-ic4>Rau 


.Ut 


F(u)  du 
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c>0  andRau  is  to  tha  right  of  all  singularities  of 
P(tt).  Nota  that  a'*^  P(u)  du  is  then  the  inverse 

L^laca  transform  of  F (u) . 

Using  the  above  thaoram#  it  is  possible  to  derive  the 
first  moments  of  the  distributions  of  h and  1.  There  are 

For  M<» 

E{t}  - {B/a){(l+a/N)”-l} 

E{h}  - Sd+a/N)**"^  (Eq.2.2) 

For 

E{1)  - (6/a) (e*-l) 

E{h>  - 6a*  (Bq.2.3) 

% 

For  the  equivalent  M/G/1  queue  it  is  known  that  the 
queueing  process  will  have  a steady  state  as  t-^  only  if 
AE(h*i)  < 1.  Cohen  has  shown  that  for  the  gradual  input 
queue/  the  following  equivalence  exists. 


Having  found  tha  axpected  value  of  h-£  and  the  conditions 
under  which  the  queueing  process  has  a steady  state » it  is  now 
possible  to  apply  the  following  theorem  by  Cohen  to  obtain  a 
useful  measure  of  the  buffer  build  up  occurring  in  a gradual 
input  queiM. 

Theorem  (Theorem  3.4  (COHEN  74]) 

The  maximum  content  C^^^  of  the  buffer  during  a busy 

cycle  has  the  same  distribution  as  the  distribution  of  the 

maximum  virtual  waiting  time  v^^^  during  a busy  cycle  of  an 

M/6/1  queue  with  a service  time  distribution  which  is  the 

same  as  that  of  h.-i.  and  mean  Interarrival  time  The 

n n 

virtual  waiting  time,  v(t),  of  the  tt/G/1  queue  is  the  total 
aremsining  service  time  of  the  customers  in  the  queue  at  time 
t.  This  is  the  time  a customer  would  have  to  wait  before 
starting  service  ^ he  arrived  at  time  t.  Note  that  this  is 
not  the  same  as  the  actual  waiting  time  since  v(t}  is  defined 
for  all  t while  actual  waiting  times  are  defined  only  at  the 
customer  arrival  times  [COHEN  69] . 

A result  for  v^^^  of  an  M/G/1  queue  with  mean  service 
tine  X and  mean  interarrival  tine  d which  can  now  be  applied 
is 

l{v^>  - d logtd-x/d)"^]  (Bq.2.4) 

as  given  in  [COKEN  69].  Applying  Equations  2.2  and  2.3,  one 
obtains  the  following. 
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-a} 8 

a“^{log (1-a (N-l)/N) “^+ (N-1) log (l+a/N)"^}8N<« 

Zt  is  thsrsfore  possible  to  calculate  the  expected  value  of 
the  maximum  buffer  content  during  a busy  cycle  in  closed  form. 

Another  useful  result  that  has  been  obtained  for  the 
gradual  input  queue  is  the  functional  form  of  the  distribution 
of  the  busy  period  on  the  output  channel.  Rubinovitch  [RUBIN 
73]  has  shown  that  the  output  channel  of  a gradual  input 
queue  has  the  same  busy  period  distribution  as  an  M/G/1 
queue  with  input  rate  (N-1}X  and  service  time  distribution 
B(*).t  If  0*(*)  is  the  Laplace  Stieltjes  transform  of  the 
distribution  of  the  busy  period  on  the  output  channel  then 

D*(e)  ■ B*{(N-1)X+  e - (N-1)XD*(0))  Re  9 > 0 

This  is  the  well  known  busy  period  result  for  an  M/G/1  queue 
(XLBIN  7S]. 

The  results  so  far  apply  only  to  a single  stage  of 
buffering.  It  is,  however,  straight  forward  to  extend  the 
results  to  several  stages  of  channels  arranged  in  a converging 
tree  structure.  This  is  done  by  observing  that  the  output 


tMote  that  this  M/G/1  analogy  is  not  the  same  as  the  one 
used  to  obtain  the  previous  buffering  result. 


etaann«l  of  on*  stags  behaves  as  an  alternating  renewal  process 
ae  required  for  it  to  be  the  input  process  to  the  next  stage. 
Zt  is  therefore  possible  to  analyze  a converging  tree 
structure  in  a stage  by  stage  manner. 

This  section  has  been  restricted  to  queues  for  which  all 
input  ch^mneXs  have  identical  alternating  renewal  processes. 
The  resiats  presented  here  have  been  generalized  to  the  case 
of  different  renewal  processest  for  each  input  channel  by 
Kaspi  and  Rubinovitch  [KASPI  75].  A summary  of  their  work  is 
given  in  Appendix  A. 

2.1.2  Equivalent  M/G/1  queue  service  tine  analysis 

Zn  the  previous  section  it  was  shown  that  the  queueing 
process  in  a gradual  input  queue  can  be  analyzed  by  making  an 
analogy  with  an  M/G/1  queue.  The  equivalent  M/G/1  service 
time  distribution  is  the  same  as  the  distribution  of  h-i,  the 
queue  buildup  during  an  inflow  period  of  the  gradual  input 
queue.  Zn  this  section  the  Laplace  transform  of  the  distri- 
bution c>f  h-£  is  obtained  for  specific  cases.  The  specific 
cases  considered  are  ones  in  which  the  on  times,  4,  as 

j 

wall  as  the  off  times,  the  input  channels  are 

exponentially  distributed.  These  special  cases  are  required 
for  the  analysis  of  the  general  networks  presented  in 
Chapter  3. 

tThe  off  periods  on  each  channel  are  still  required  to  be 
exponentially  distributed. 
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TIm  results  presented  here  are  obtained  by  using  a 
Markov  chain  representation  for  the  behavior  of  the  input 
channels  to  the  queue.  This  approach  is  easier  to  understand 
than  using  the  relationship  given  by  Cohen  for  E{exp ("ph-si) }t 
Zt  also  allows  one  to  analyse  queues  for  which  the  input 
channel  capacity  is  larger  than  that  of  the  output  channel. 


Cohen's  result  (Theorem  2.3  [COHEN  741)  is  stated  in  the 
prevlo^  section.  Note  that  it  gives  E{exp  (-ph-si) } for 
Rep  -0,  Res>0.  Therefore  in  order  to  use  the  result 
to  obtain  E(e^  (-P  (h-i) ) } analytic  continuation  must  be 
used.  Appendix  A-4  of  [COKEN  74]  shows  how  to  do  this  for 
the  case  of  am  infinite  number  of  input^channels  (N«o) . 

The  result  for  this  case  is  that  for  p - 0, 


P-A{1-S(P)  } 

p-Atl-Etexp {-p (h-i) J i > 


l-A/*E{exp  (-P  (B-t)  I (B-t)  }exp  /.  u“%"^{l-B  (p+u) } 

0 ^u 


dujdt 


Hhere  B has  distribution  B(*)  auad  (B>t) 


1 if  B-t 
0 otherwise 
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Th«  alternating  on/off  renewal  process  associated  with 
a commiinication  channel  on  which  these  times  are  exponentially 
distributed  can  be  represented  as  a two  state  continuous 
time  Harkov  chain.  Let  the  off  times  have  distribution 
function 

A(t)  - l-e“^^  t > 0,  X > 0 

0 t - 0 

and  the  on  times  have  distribution  fvuiction 

B{t)  - l-e“^^  t > 0,  y > 0 

0 t - 0 

Then  the  behavior  of  the  channel  can  be  represented  by  the 

Markov  chain  shown  in  Figure  2.3a.  If  there  are  N independent 
* 

input  chemnels,  their  joint  behavior  can  also  be  represented 
by  a Markov  chain.  The  chain  representing  the  joint  behavior 
of  three  identical  input  channels  is  shown  in  Fig\ire  2.3b. 

The  states  of  the  chain  are  the  number  of  channels  on  and  the 
number  off.  The  transition  times  between  the-  states  are 
exponentially  distributed  as  required  for  the  system  to  be  a 
continuous  time  Markov  chain.  This  follows'  from  the  memory- 
less property  of  the  exponential  distribution  and  the  fact 


J*'.'  . 

. JfcLil. 
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A.  A single  gradual  Input  channel. 


b«  Three  identical  gradual  input  channels. 


FIGURE  2.3  - Rate  diagrams  for  Markov  chain  representations 
of  the  behavior  of  gradual  input  channels 
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that  the  time  to  a state  transition  is  given  by  the  minimum 
of  a set  of  Independent  exponential  distributions  (the  set 
of  tiioes  until  the  next  transition  on  each  channel) . It  is 
well  known  that  the  minimxim  of  such  a set  is  exponentially 
distributed. 

Xt  is  also  straightforward  to  extend  the  Markov  chain 
representation  to  independent  input  channels  with  different 
traffic  parameters.  Figure  2.3c  illustrates  the  Markov 
chain  for  the  joint  behavior  of  two  input  channels  with  mean 
on  and  off  times  auid  (Uj/  ^2^)  • 

Bdw  recall  that  the  quantity  h-i  is  the  queue  buildup 
during  an  inflow  period  of  the  gradual  input  queue.  This 
time  period  can  easily  be  identified  in  the  Mcrkov  chain 
representation  of  the  input  channels.  An  inflow  period 
starta  with  a transition  from  all  inputs  off  to  one  input 
on  and  ends  on  the  first  return  to  the  state  with  all  inputs 
off.  Therefore  an  inflow  period  is  a first  passage  event 
in  this  Markov  chain. 

The  excess  queue  buildup,  h-i,  during  this  first  passage 
event  can  now  be  identified.  This  can  be  done  for  queues 
with  input  channel  capacities,  Cj^,  which  are  greater  than  or 
equal  to  tlie  output  channel  capacity,  C^.  For  such  a queue, 
whenever  the  input  channels  are  in  a state  w..th  input 

channels  on,  the  buffer  content  of  the  queue  increases  at 
rata  c^,  where 


1 

i 

\ 
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- Co 


(Eq.2.S) 


Eqiiation  2.5  can  now  be  used  to  scale  the  transition  tine 
distributions  for  the  input  channel  Markov  chain  so  that  the 
tine  spent  in  each  state  represents  the  excess  queue  buildup 
while  in  that  state.  In  the  resulting  scaled  Markov  chain, 
the  tine  for  the  first  passage  event  that  starts  fron  the 
all  channels  off  state  with  one  input  coning  on  and  ends  upon 
the  first  return  to  the  all  off  state  is  equal  to  the  quantity 
h-1. 

The  use  of  the  scaled  Markov  chain  to  detemine  the 
Laplace  transfom  H*(s)  of  the  distribution  of  h**i  is  best 
illustrated  by  an  exanple.  The  unsealed  Markov  chain 
representing  three  identical  gradual  input  channels  was 
shown  in  Figure  2.3b.  If  these  channels  have  capacity 

• 1,  then  the  scaled  Markov  chain  representing  the 
rate  of  queue  btiildup  will  be  as  shown  in  Figure  2.4.  Note 
that  state  1 (all  channels  off)  is  shown  as  a trapping  state 
because  it  is  the  end  state  of  the  first  passage  event  of  • 
interest.  As  such,  the  time  until  trapping  in  state  1 will 
be  the  same  as  the  first  passage  time  to  that  state.  Also 
note  that  since  there  is  no  queue  buildup  in  state  2 (one 
input  on) , there  are  infinite  transition  rates  out  of  this 
state  in  the 'Scaled  chair. 


Lmt  x(t)  b«  th«  state  o£  the  scaled  Markov  chain.  Then, 
as  discussed  previously,  h-l  is  equal  to  the  following  first 

passage  tine 

• inf{t;  x(t)«l(x(0)  - 2) 


probability  density  function  of  fj^^,  then 
the  desired  transform  is 


FJ^(s)  - H*(s) 


/*  a”**f  {t)dt 
t-0 


This  transform  can  be  found  by  general  methods,  such  as  those 
given  by.  Howard  [HOWD  71] , or  by  taking  advantage  of  the 
special  structure  of  the  chain  as  discussed  below,  in  either 
case,  transition  probabilities  {next  state^j  {current 

state<"i}  and  waiting  time  probability  density  functions  w.  . (t) 
must  be  identified.  For  the  cha'in  shown  in  Pigxire  2.4,  the 
matrix  of  transition  probabilities  is 


1 

0 

0 

0 

F- 

sferr 

0 

21 

• 0 

0 

*0 

X 

2w+\ 

0 

0 

1 

0 
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Th«  density  functions  (t)  ar«  ths  densities  of  the  time 
until  transition,  given  that  a transition  from  state  i to  j 
will  occur,  and  zero  if  a direct  transition  is  not  possible 
from  i to  j.  For  the  continuous  time  Markov  chain  under 
consideration  here,  these  are  all  exponential.  The  mean  tii 


0 


(U+2X)t 


0 (u-«‘2X)e 

3U^ 


Since  state  1 ie  a trapping  state,  probability 

density  functim  such  that  ■ 0 if  t < 0. 

From  the  matrix  ^(t)  it  is  easy  to  generate  the  matrix 
of  Laplace  transforms  of  the  waiting  time  densities. 


B«c«tts«  of  th«  siinplo  struetur*  of  tho  Markov  chain,  tha 
tranaform  can  aaaily  ba  found  by  tha  following  mathod. 

Lat  yjj  and  y^^  ba  tha  numbar  of  stata  2 to  stata  3 and 
atata  3 to  atata  4 tranaitiona  that  ara  aada  during  tha 
firat  paaaaga  avant  atarting  from  atata  2 and  anding  in 

Knowing  yj^  and  y^^  ia  aquivalant  to  knowing  tha 
numbar  of  timaa  atataa  2,  3,  and  4 wara  antarad  bafora  tha 
trapping  stata  1 waa  raachad.  Tha  tranaform  can 

hharafora  ba  found  by  summing  conditional  transforms  as 
follows 


FJi(a) 


r 

All  poasibla  j,k 


y3«-k) 


*''ll***P21  * (>'{5(»)w!,(t))^ 

“ All  poMibl*  j,k  " 

<»S4 <•>’'53 <*>>''  <PJ3P32>^  <P34P43>’‘ 


"Jl'*'*’21  I „ (“Is  (»)''S2  <•>  <f  (''54<»)''J3(») 

3*0  i*0  ’ 

(Eg.  2. 6} 


^34^32^ ^^^23^32^^ 


Equation  2.6  atataa  that  thara  can  ba  j-0,1,2...  tranaitiona 
from  atata  2 to  stata  3 and  for  aach  of  thaaa  thara  can  ba 
i«0/l,2,...  tranaitiona  from  stata  3 to  stata  4 bafora  "trapping 


in  «tat«  1.  For  each  atat*  3 to  stata  4 transition,  tha 
. transform  of  tha  tima  from  starting  In  stata  3 until 
ratuming  to  that  stata  is  w*^  (s)w*3  (a) . This  transition 
occurs  with  probabiUty  P34P43.  Similarly,  for  aach  stata  2 
to  stata  3 transition,  tha  transform  of  tha  tima  from 
starting  in  stata  2 until  ratuming  to  that  stata  is 

m 

wjj  (*)w|2  (s)  (w*^  ^■^''43  *•*^34^43^^*  • Tha  last  sum 

accounts  for  transitions  to  stata  4 onca  stata  3 is  raaehad. 
Tha  transition  from  stata  2 to  stata  3 and  back  to  2 occurs 
with  probability  P23P32*  Finally,  aach  first  passage  avant 
considarad  hara  involves  one  transition  from  stata  2 to 
•tata  1 which  occurs  with  probability  Pj^^  and  has  transform 

An  aquation  similar  to  Equation  2.6  can  be  written  for 
other  siE^la  gradual  input  queues.  Table  2.1  gives  tha 
resulting  transforms  H*(s)  for  tha  case  presented  above  and 
other  cases  that  are  used  in  this  study. 

As  mantionad  previously,  the  Markov  chain  technique 
can  be  applied  to  gradual  input  queues  with  channal 
capacities  > c^.  One  example  of  this  is  given  in’ 

Table  2.1.  Tha  Markov  chain  technique  cannot. be  applied  if 
Cf  < because  than  tha  basic  M/G/1  queue  analogy  no 
longer  holds.  Tha  M/G/1  analogy  requires  that  tha  queue 
coatent  be  nondacraasing  during  an  inflow  period  and  that  is 
act  tha  case  if  < C^.  Onlass  otherwise  stated,  all  cases 

ooasidarad  ia  this  study  have  C,  ■ C . 

X o 
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TABLB  2.1 


\t(a^B+2v) 

2 identical  Inputs  - ■ . ■ ■ - where 


Th«r«  is  anothsr  approach  to  finding  that  can  bs 

ossd.  Bovmrd  [HOHD  71]  gives  the  result  that  the  matrix  of 
first  passage  time  distributions  for  a continuous  time 
Markov  chain  satisfies  the  following  relationship. 

F*(s)  - ?*{s)  ni-?*(a))*^]  [(I-?*(s))“^n  I]"^ 

(*q.2.7) 

Ihe  matrix  ?*(s)  is  .ailed  the  core  matrix.  Zt  is  defined 
as  follows 

?*(s)  • ?□  W*(s) 

The  operator  Q in  the  above  equations  signifies  elenzent  by 
elesMnt  multiplication  of  the  two  matrices.  For  the  gradual 
input  qxieues  considered  in  this  study  it  is  easier  to  write 
an  equation  like  Equation  2.6  than  to  perform  the  matrix 
inversions  required  in  Equation  2.7.  The  infinite  sums  in 
Equation  2.6  are  all  sisals  geometric  sums  for  which  closed 
form  es^ressions  exist. 
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2»1»3  Bound*  for  th»  exoect»d  delay  per  bit 


A porfornanco  moasuro  that  is  oftan  of  intarast  for 
■assaga  awitchad  connaxinication  natwork*  is  dalay.  In 
praviou*  studias  using  tha  M/M/1  guaua  as  a modal,  tha  delay 
****'*^*  usually  considered  was  expected  dalay  per  massage. 
For  tha  gradual  input  modal  this  maasura  is  difficult  to 
find  because  tha  distributions  obtainad  for  buffer  content 
are  not  ajq>rassad  in  terms  of  number  of  massages.  Instead 
buffer  contents  are  expressed  in  terms  of  time  units  of  work 
(for  the  output  channel)  which  represent  bits  when  normalized 
by  the  commiuication  rate  of  the  output  channel.  Therefore 
an  expected  delay  per  bit  measure  will  be  used  for  the 
gradual  input  queue . 

The  delay  experienced  by  a specific  bit  in  a gradual 
input  queue  is  a function  of  the  queue  contents  at  the  time 
of  it*  arrival  and  of  the  service  discipline  of  the  queue. 

The  service  discipline  in  the  qtieue  may  be  difficult  to 
represent  mathematically.  For  example,  suppose  that  messages 
are  sent  on  a first-come-first-served  (POPS)  basis.  Then  the 
bitt  are  not  sent  strictly* PCPS . Portunately,  as  long  as  the 
service  discipline  is  work  consej^ing,  the  mean  delay  per  bit 
remains  unchanged. t Therefore  the  mean  delay  per  bit  c«m  be 
found  assuming  FCFS  service  for  all  bits. 


tThis  follows  fran  Little's  formula  [LTTL  61 J,  L-XW,  which 
says  that  the  expected  delay  W for  a queue  equals  the  exoected 
queue  size  L divided  by  the  mean  arrival  rate  X.  All  work 
®^**^ing  service  disciplines  give  the  same  expected  queue 
sise  in  terms  of  bits  for  the  gradual  input  queue. 


mth  th«  TCFS  Mmrvicm  discipline^  it  is  easy  to  see  that 
the  delay  for  a specific  bit  is 


For  the  gradtial  input  queue , this  means  that  only  the  queue 
sisei  during  Inflow  periods  is  of  interest  since  that  is  the 
only  time  during  which  bits  arrive.  Figure  2.5  shows  the 
buffer 'content  during  a typical  inflow  period.  Determining 
the  exact  delay  per  bit  during  this  period  is  very  difficult 
However,  this  delay  can  easily  be  bounded.  Note  that  at  the 
start  of  the  inflow  period  the  delay  (buffer  content)  is 
while  at  the  end  it  is  The  delay  is  strictly 

nondeereasing  during  the  inflow  period.  If  one  considers 
M inflow  periods,  the  average  delay  per  bit  is  bounded  by 


Taking  the  limit  as  H*m  and  making  an  ergodic  argument  gives 


Buffar  content 


FIGURE  2.5  - A single  inflow  period  of  the  gradual  input 
queue.  The  total  inflow  dxiring  the  period 


47 


sine*  and  are  Indapandent,  these  bounds  simplify  to 


*M  - ItV  i J ♦ E(wl 


(Eq:2.8) 


■w  recall  that  w is  the  actual  waiting  time  of  an 

equivalent  M/G/1  queue.  Assume  that  the  gradual  input  queue 

has  If  input  channels  with  mean  off  times  (i  • 1,2,..N). 

Then  the  equivalent  M/G/1  queue  has  mean  inter arrival  ti™> 

® ”1 

(I  ^^i^  * service  time  distribution  equal  to  the  dis- 

tribution of  h-i.  Therefore  Efw]  can  be  found  using  the  well 
known  Pollacsek-Khintchine  formula  [KLEIN  .75]  for  the  mean 
waiting  time  in  an  M/G/1  queue. 


X E[(h-l)*1 

i[(h 


(Eq.2.9) 


Inhere  X-  • £ X. 
^ i-1  ^ 


Equation  2.9,  together  with  Equation  2.3,  gives  both  upper 
and  lower  bounds  on  E[d^l  in  terms  of  first  and  second 
aoaents  of  the  fundamental’  quantities  h and  i.  An  example 
of  the  bounds  is  given  in  Section  2.3. 


\ 

! 


2.2  The  Gradual  Input  Queue  With  A Finite  Buffer 


2.2.1  Probability  of  buffer  overflow  in  a busy  period 

A probability  of  buffer  overflow  measure  is  Required 
In  order  to  be  able  to  use  the  gradual  input  queueing  model 
to  study  buffering  requirements  for  a communication  network. 
The  key  to  calculating  a probability  of  buffer  overflow  for 
this  queueing  model  with  a finite  buffer  is  to  use  a pro- 
bability that  is  convenient  to  work  with.  The  most  convenient 
is  the  probability  of  one  or  more  buffer  overflow  events 
during  a busy  period » and  this  is  the  measure  used  in  this 
study.  This  measure  is  convenient  because  the  start  of  each 
busy  period  is  a renewal  point  for  the  queueing  process  in 
the  gradual  input  model.  At  this  pointy  all  but  one  of  the 
inputs  are  off  with  em  exponentially  distributed  time 
remaining  until  they  come  on  again.  In  addition,  the  buffer 
is  esqpty  so  that,  stochastically,  a queue  with  an  infinite 
buffer  and  one  with  a finite  buffer  behave  identically  from 
the  start  of  a busy  period  until  the  finite  buffer  overflows. 
For  any  busy  period  then,  the  probability  of  no  overflow  for 
the  finite  buffer  is  the  same  as  the  probability  that  the  • 
buffer  content  of  the  infinite  buffer  never  crosses  the 
level  equal  to  the  size  of  the  finite  buffer  during  the  busy 
period. 

The  analogy  between  the  contents  of  a gradual  input 
queue  and  the  virtual  waiting  time  in  an  M/G/1  queue  can  now 
be  applied.  For  a gradiial  input  queue  with,  buffer  size  K 
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P .No  overflow  during, 
busy  period  ' 


Pr(^max  ^ a busy  period^ 

of  equivalent  M/G/1  queue 


where  the  equivalent  M/G/1  queue  has  an  infinite  buffer,  a 
mean  interarrival  time  of  A”"^  and  a service  time  distribution 
that  is  the  same  as  the  distribution  of  h-f.  Let  w be  the 
actual  waiting  time  for  the  equivalent  M/G/1  queue  and  y be 
a random  variable  with  the  same  distribution  as  the  service 
time.  Then  the  following  result  for  an  M/G/1  queue  can  be 
used 


^ ' w"’ 


Pr  (w+y-K) 
Pr (w^k) 


(Eq.2.10) 

Ref.  (COHEN  69]  p.  525 
(TAKACS  65]  p.  381 


By  using  the  fact  that  Pr (v  >K)»1-Pr (v  -K) , Equation  2.10 

uiaX  tnaX 

provides  a way  of  theoretically  calculating  the  probability 
of  one  or  more  overflow  events  during  the  busy  period  of  the 
gradual  input  queue  with  buffer  size  K.  Specifically, 


-^.Overflow  during, 
" ^buay  period  ' 


(V 


max 


■ Pr(w-K)  - Pr(w-fy-K) 
Pr  (wi-K) 


Pr(w<-y>K)  - Pr(w>K) 
1-Pr (w>K) 


(Eq.2.11) 


I 


Because  the  distributions  of  w and  y for  the  M/G/1 

queue  analogy  are  fairly  complicated,  it  is  worthwhile 

trying  to  bound  the  probability  of  overflow  rather  than 

calculating  it  exactly.  This  can  be  done  by  applying  the 

esqionential  bounds  on  the  waiting  time  in  G/G/1  queues 

developed  by  Kingman  [KII^G  70].  For  a G/G/1  queue,  denote 

the  service  time  of  the  nth  customer  by  x and  the  interval 

n 

between  arrivals  of  the  (n+l)st  and  nth  customer  by  t^.  Now 
define  the  remdom  variable 


la  an  intarval  1 in  which  f (8)  is  bounded.  This  interval 
includes  the  origin  eaQ  since  £(0}«1.  Furthermore,  it  can  be 
shown  that  f(d)  is  a convex  a fxinctiont  and  that  £'(0)  « 
B(x-t}<0  for  a queue  with  a utilization  <1.  It  can  also  be 
seen  that 


£(0)  - A*(0)B*(-9) 


(Eq.2.14) 


where  A*(d)  and  B*(d)  are  the  Laplace  transforms  of  the 

interarrival  time,  t , and  service  time,  x_,  distributions 

n n 

respectively. 

The  bound  in  Equation  2.12  can  be  applied  to  Equation 
2.11  yielding 


Pr  (overflow)  1 


-0K 


1 - e 


(Eq.2.15) 


The  problem  now  is  to  bound  the  Pr (w+y>K) . This  can  be  done 
by  noting  that 


Pr(w+y>K)  ■ Pr(y>K)  + / Pr(w>(K-t))  dH(t) 

t-0 


where  H(t)  is  the  distribution  function  of  h-i. 


tThe  function  f(e)  is  convex  U if 

fCoej^-^ (1-0)02)  " ci3f(0i)  + (l-a)f(02)J  0 - o - 1. 
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Using  the  fact  that  Pr(y>K)  ■ /*  dH(t)  and  that 

t-K 

Pr(w>0)  a I,  one  obtains 


Pr(iH»y>K)  a r Pr(w>(K-t))dH(t)  - /*  a"®  dH(t) 

t-0  t-O 


H*(-0)e"®*^  {Eq.2.16) 


This  expression  for  .^r(w+y>K)  can  be  substituted  into 
Equation  2,15  giving  the  following  exponential  bound  on  the 
probability  of  one  or  more  overflows  during  a busy  period  of 
a gradual  input  queue  with  buffer  size  K. 


Pr (overflow) 


\ < (H* (-e)-r)e' 


1 - e 


(Eq.2.17) 


This  exponential  boxind  can  be  applied  in  a straightforward 
manner  except  for  the  constant  r.  The  constat  r is  difficult 
to  determine  exactly  in  general.  Fortunately,  however#  it  is 
easy  to  see  from  its  definition  that  r-0.  Therefore  setting 
raO  still  gives  an  upper  bovind,  i.e. 


Pr (overflow)  - 

1 - e“ 


(Eq.2.18) 


The  effect  of  letting  r«0  is  to  weaken  the  bound,  but  the 
correct  exponential  behavior  is  preserved.  The  next  section 
gives  an  example  that  illustrates  this  effect. 
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Zt  is  dssirabls  to  havs  a lower  bound  as  well  as  an 
i^per  bound  on  the  Pr (overflow)  as  defined  in  this  section. 
One  can  start  with  Equation  2.10  and  apply  the  Kingman 
bounds  on  waiting  time  to  obtain  a lower  bound,  but  in  this 
case,  since  the  constant  r cannot  be  determined,  the  bound 
is  useless.  Therefore  the  alternative  that  will  be  used  is 
to  realize  that  for  a gradual  input  queue 

m 

Pr (overflow)  » Z Pr (Overflow  in  ith  inflow  period) 
i»l 

- Pr (Overflow  in  1st. inf low  period) 

* Pr (h^i>buff9r  size)  (Eq,2,19) 

Here  only  the  first  inflow  period  has  been  used  to  obtain  a 
lower  bound.  If  a tighter  bound  is  desired,  more  inflow 

e 

periods  can  be  considered. 

The  bounds  developed  here  for  Pr (overflow)  are 
illustrated  with  exanqples  in  the  next  section  that  indicate 
their  tightness. 

2*2.2  Examples  of  the  bounds  on  Pr (Overflow) 

TWO  examples  of  the  use  of  the  bounds  on  Pr (overflow) 
are  given  in  this  section.  The  first  is  a gradual  input 
queue  which  is  used  to  illustrate  the  general  procedure. 


TIi«  SAcond  is  an  M/M/1  qusus  which  is  pressntsd  to  show  how 
ths  yjpTpmr  bound  compares  with  the  exact  value. 

As  a first  example / consider  a gradual  input  queue 
with  three  identical  input  channels.  The  on  and  off  times 
on  each  chaiuel  are  exponentially  distributed  with  means 
M ^ ^“5  respectively.  This  gives  an  output  channel 

tthiiisstiou  of  0.5  if  no  traffic  losses  occur . 

As  described  previously,  the  Pr (overflow)  for  this 
queue  with  buffer  size  K can  be  determined  by  considering 
an  equivalent  M/G/1  queue.  The  equivalent  M/G/1  queue  has 
an  interarrival  time  distribution  with  Laplace  transform 


A*  (8) 


_ 31  _ 0.6 

" ypiT  " ?+Trs‘ 


This  is  the  transform  for  the  time  between  inflow  periods. 
The  transform  for  the  equivalent  service  time  is  the  same 
as  the  transform  of  h-i. 


■*(8)  - H*(0)  - ■2J.?^'*‘<2Xut7u^)6->-6u^ 

(2U+4X)  0^+  (4A^>2Am+7w^)  0+^ 

• _ 20^  «f  7.40  + 6 

■ ■ .r 

2. SO**  + 8.760  + 6 

MOW  the  problem  is  to  find  the  exponent  9*  for  the 
exponential  bound.  The  exponent  is  the  unique  positive 
real  solution  to 


£(•)  - A*(e)B*(-e)  - 1 


iihich  li«s  in  «n  interval  Ig  in  which  £(6)  is  boundad.  For 
tb«  axan^la  conaidarad  hara,  this  aquation  has  thraa  solutions 
0,  0.902  and  2.055.  Of  thasa,  only  0.902  is  positiva  raal 
and  in  Z^.  Tha  root  2.055  lias  outsida  of  Z^  baeausa  tha 
function  B*(-o)  has  a pola  at  1.01.  Tha  uniquanass  of  e*  is 
tbarafora  as  pradictad  by  tha  Kingman  thaory.  Tha  bound  is 
oomplatad  by  finding 

- H*{-0.902)  - 2.503 


Tharafora 


< 2 503a"® 

Pr(ovarflov)  1 

whara  X is  tha  btiffar  siza.  This  bound  is  plottad  in  Figura 
2.6.  Notiea  that  for  small  valuas  of  X tha  bound  bacomas 
larga  baeausa  of  tha  danominator.  Tharafora  anothar  bound 
has  baan  usad  in  this  ragion. 

Tha  bound  usad  for  small  buffar  sizas  is  tha  Pr(ovarflow) 
whan  X*0.  For  X*0  tha  following  is  trua. 

l->Pr  (ovarf low)  • Pr  (First  input  channal  goas  off  bafora 

a sacond  ona  comas  on) 

fe 
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'for  channel'  ' ^£or  ehaxuiel  ^ ^ 

■ /*  dt 

t^O 

• ife  • ITT  ■ 

Claarly  thia  axaet  aolution  for  K«0  la  an  uppar  bound  for  K>0. 

Iha  Xowar  bound  to  Pr(ovarflow)  that  waa  davalopad  in 
tha  pravloua  aactlon  la 

Pr(ovarflow)  - Pr(h*i>K) 

Zn  ordar  to  avaluata  thia  bound,  tha  tranafonu  H*(9)  muat 
ba  invartad.  For  thia  axanpla 


■*(0) 


20*  » 7.49  ♦ 6 
2.89^  * 8.760  6 


_ M , O»4O80  ♦ 0«6X2 


Ibarafora  uaing  atandard  inva^raion  techniquaa,  ona  obtaina 


B(t)«O.7X40  (t)4>(.X78)  (X.0X3)a“^*®^^^+  (.X08)  (2,XX6)a”^*^^*^ 


t-0- 


whara  j (t)  ■ X if  t«0 

■ ‘0  otharwiaa 
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rron  this  It  is  Msy  to  find  ths  bound. 

Pr(h-1>K)  • /*  H{t)dt  - 

t^K 

This  bound  is  also  shown  in  Flgura  2.6. 

Am  a soeond  oxasiplsr  an  M/M/1  guaus  will  ba  consldarad. 
Tha  M/M/1  quaua  la  a Halting  casa  of  a gradtial  Input  quaua. 
It  la  tha  caaa  with  inflnlta  capacity  input  channels  which 
allow  instantanaous  massage  aurrival.  This  is  discussed 
further  in  Section  2.3.  Hare  tha  M/M/1  example  is  of 
In^arast  because  It  can  be  used  to  compare  tha  upper  bound 
on  Pr (overflow)  with  the  exact  solution, 
laeall  that 

' _ . . Pr  (w+y>K)  - Pr  (w>!C) 

Pr  (overflow)  - 

por  an  M/M/1  queue  with  mean  arrival  rata  X and  mean  service 
^4—  the  service  time  y has  distribution 

Pr(y-t)  • 1 - a"'*^  t>0,  u>0 

0 t-0 


Tha  distribution  of  tha  actual  waiting  time  w is  [KLEZM  75] 


from,  thi*  th«  required  Pr(w>K)  is  sasily  found  to  b« 


Th*  Pr(%H‘y>K)  can  b«  obtained  as  follows 


Pr(w+y>K)  - Pr(y>K)  + Pr(y<K  and  w+y>K) 


tr  (overflow) 


Tho  upper  bound  for  Pr (overflow)  given  by  Equation  2.18  is 
•i*®  found  for  the  M/M/1  queue.  The  bounding  exponent 

ie  detenained  using  the  eqxiation 


*(•)  - A*(9)BM-e)  . 5^  1 


1h«  solutions  to  this  equation  are  0 emd  y-X.  Therefore 
6*  « y^X  . The  v^per  bound  Is  then  given  by 


Pr (overflow)  • 


< B*(-e*)e“®*^ 


Za  comparing  the  \^per  bound  with  the  exact  solution, 
it  can  be  seen  that  the  bound  has  the  correct  exponential 
behavior.'  Table  2.2  gives  values  of  both  the  hound  and  the 
enact  solution  for  different  utilizations  emd  buffer  sizes. 
The  table  shows  that  the  bound  is  loose  for  small  buffer 
sines.  For  larger  buffer  sizes  emd  reasonably  small 
probabilities  of  buffer  overflow,  however,  the  bound  Is 
fairly  good.  In  this  region  the  difference  between  the 
two  Is  less  than  one  order  of  magnitude. 


TABLE  2.2 


Pr (ovarf low) 

for  the  M/M/1 

Queue 

Haan  massaga  langth  > 

- 1 

Utilization 

Bttffar  Size 

Pr  (overflow) 

(Xa  naan  nassaga 
lengths) 

Exact 

Upper  Bound 

0.2 

2 

0.1683 

1.2648 

0.2 

4 

3.2878x10"^ 

0.2125 

0.2 

6 

6.5946x10"^ 

4.1490x10'® 

0.2 

d 

1.3297x10'^ 

8.3216x10'® 

0.2 

10 

2.6839x10“^ 

1.6779x10'® 

0.2 

12 

5.4184x10'® 

3.3867x10'^ 

0.2 

14 

1.0939x10'® 

6.8372x10“® 

0.2 

0.5 

16 

2 

0.2254 

1.1640 

0.5 

4 

7.2579x10'^ 

0.3130 

0.5 

6 

2.5529x10'^ 

0.1048 

0.5 

8 

9.2425x10'^ 

3.7315x10'® 

0.5 

10 

3.3804x10'® 

1.3567x10“® 

0.5 

12 

1.2409x10'® 

4.9698x10"® 

0.5 

14 

4.5615x10'^ 

1.8254x10"® 

0.5 

16 

1.6776x10'^ 

6.7115x10"^ 

0.8 

2 

0.2891 

2.5416 

0.8 

4 

0.1403 

1.0200 

0.8 

6 

7.9361x10'® 

0;5388 

0.8 

8 

4.8158x10'® 

0.3162 

0.8 

10 

3.0353x10'® 

0.1956 

0.8 

12 

1.9563x10'® 

0.1247 

0.8 

14 

1.2784x10'® 

8.0934x10"® 

0.8 

16 

8.4272x10'® 

5.3118xl0“® 

2*2.3  A per  unit  time  overflow  measure 

A p«r  unit  time  overflow  measure  may  be  more  useful 
then  a probability  of  overflow  per  busy  period  in  some 
applications.  The  following  discussion  shows  how  the  upper 
bound  on  the  probadsility  of  overflow  per  busy  period  developed 
in  Section  2.2.1  can  be  converted  to  two  different  lower 
bounds  on  expected  time  to  buffer  overflow. 

For  the  first  bound,  lot  E{Tq}  be  the  expected  time  to 
the  first  buffer  overflow  of  a gradual  input  queue,  starting 
from  the  beginning  of  a busy  period.  This  expected  time  can 
be  expressed  as  a sum  of  expected  times  to  overflow  that  are 
conditioned  on  the  busy  period  in  which  the  overflow  occurred, 
i *e* , 


B{To)  • ®^^ol^^overflow  * ^^^overf low  " 

' , (Bq.2.20) 

NOW  each  term  in  this  equation  will  be  examined. 

First  consider  the  conditional  expected  times 

• i}.  Figure  2.7a  illustrates  the  sequence 
of  idle  and  busy  periods  that  proceed  an  overflow  in  the  ith 
busy  period.  From  the  figure  it  is  easy  to  see  that 


i « 1,2,3. 
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t 


Busy 


Idl«  Busy 


Busy 


b. 


Osfinitlon  of  T 


OC 


FIGURE  2.7  > Osfinitions  of  tinss  bstvssn  ovsr flows 


«rh«r« 

B{TbpnoJ  * Expected  length  of  a busy  period  in  which  no 
overflow  occurs 

» Expected  idle  time  between  busy  periods 
BCTfapo^  * Expected  time  from  the  start  of  a busy  period 
until  the  first  overflow,  given  that  at 
least  one  overflow  occurs  in  that  busy  period 


As  discussed  in  Section  2.1.1,  the  off  times  on  all 
input  channels  of  a gradual  input  queue  are  taken  to  be 
exponentially  distributed.  Therefore  if  there  are  N input 
channels  with  mean  off  times  (i«l,2,..N),  then 


®^^idle 

< 


N 

} - II 
i-1 


Finding  E{TbpQ}  exactly  is  a difficult  unsolved  problem. 
It  is,  however,  straightforward  to  lower  bound  eCt^pq)  by 
physical  reasoning.  If  the  gradual  input  queue  has  N inputs 
and  buffer  size  K,  then  the  shortest  time  in  which  the  buffer 
can  be  filled  is  K/(N-1).  Here^  as  elsewhere  in  this  study, 
it  is  assumed  that  the  commxinication  channels  associated 
with  the  queue  all  operate  at  a rate  >1.' 

Determining  ECT^pj^^}  exactly  is  another  difficult 
problem.  Again,  however,  a simple  lower  bound  can  be  found 
by  physical  reasoning.  For  a gradual  input  queue  with  a 
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\ 

I \ 





finite  buffer^  a busy  period  consists  of  at  least  one  complete 
Mssage  (on  time  on  an  input  channel),  whether  or  not  there  is 
overflow  during  the  busy  period.  Therefore  if  the  mean  length 
of  an  on  time  on  an  input  channel  is  then 


«*bpno>  - 


NOW  consider  the  terms  Pr  • ®y  noting 

that  busy  periods  of  a queue  are  independent,  it  follows  that 


(bPo^erf low  “ ^0 


i * 1,2,.... 


idiere  Pq  is  the  probability  of  buffer  overflow  in  one  busy 
period.  Combining  this  with  the  previous  analysis  of 

«*ol'’Pov.rflow  * 


i-1 


1-P, 


- I=^%no>*2^Tidle>I<-?f’^®f^bpo> 

N 1*P 

- (u*^  (I  X,)"^)  (-5-2-)  + K/(N-1) 

i-1  ^ *^0 

TtM  bound  for  £{Tq}  still  involves  the  probability  P^  which 
is  difficult  to  evaluate  exactly.  This  difficulty  can  be 
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overcome  by  applying  the  upper  bound  for  Pq  derived  in 
Section  2.1,1.  Denote  this  upper  bound  by  P^.  Then  - P^ 
and  therefore 


and 


1 - 'ff  - 1 - »0 


and  therefore 


> N , 1-P 

B{Tq}-  (u  * * K/<N-1)  (Bg.2.21) 


As  an  example  of  the  use  of  this  bound#  consider  a two 

input  gradual  input  queue  with  buffer  sise  K.  Let  the  mean 

on  and  off  times  on  both  channels  be  ■ 1 and  ■ 3 
% 

respectively. 

first  step  in  bounding  ECTq)  is  to  bound  Pg.  The 
upper  bound  for  Pg  developed  in  Section  2.1.1  is 


pip-  H_*{«9*)e"^*^^ 


For  this  example  8*  - 1.34  and  - 3.  The  expected 

®^^idle^  " ^i^  ^ " (.667)  ^ ■ 1.5  while  the  expecte 

tia*  i 1.  Therefore 
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B{Tq}  - 2.5  -p  ” + K 


TAbltt  2.3  gives  the  value  of  this  bound  for  three  different 
buffer  sizes. 

TABLE  2.3 

X^wer  Bound  on  E{Tq}  for  a ^o  Input  Gradual  Input  Queue 

Input  Mean  on  Time  • 1 
Input  Me«ui  off  Time  > 3 


Buffer  size 
(I  Tinit  a I 
mean  input 
on  time) 


10 

15 


Opper  bound  on 
Pr  (overflow) 


3.82  X 10 

4.85  X 10 
6.18  X 10 


-3 

-6 


Lower  bound  on 
E(Tj) 


6.56  X 10' 


-9 


5.15  X 10* 
4.05  X 10 


8 


A second  bound  for  an  expected  time  to  buffer  overflow 
will  now  be  developed.  Let  be  the  time  between  the  end 

of  a busy  period  in  which  there  was  an  overflow  and  the  end 
of  the  next  busy  pjsriod  in  which  there  is  another  overflow » 
i.e.  the  time  for  one  overflow  cycle.  Then  Tq^  represents 
the  length  of  a renewal  event  that  contains  exactly  one  busy 
period  in  trhich  there  is  buffer  overflow.  This  is  illustrated 
in  Figure  2.7b. 
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■w.  ' 


Nov  consider  a saquanca  of  M busy  periods  of  a gradual 
Input  queue  with  a finite  buffer.  The  expected  number  of 
busy  periods  in  which  there  is  at  least  one  overflow  is  then 
M Pr  (overflow)  ■ h P^.  Therefore  as  M***,  the  expected  total 
tine  in  which  the  M busy  periods  occur  is  given  by 


or 

‘ (Eq.2.22) 

How  in  order  to  lower  bound  E{Tq^  an  upper  bound,  for 
Pq  can  be  used  as  before.  The  remaining  problem  is  to  lower 
bound  for  the  finite  buffer. 

N busy  cycles  occur  in  the  time  ^(^^otal^*  Each  busy 
oyole  includes  a busy  period  and  an  idle  period.  Therefore 


The  time  E{T^j^^>  is  easy  to  find  as  discussed  previously 
and  E(T^}  can  be  lower  bounded  by  as  was  done  for 
•^*bpno>*  drives  the  following  lower  bound 


69 


■ot*  that  thl*  is  vsry  aimilsr  to  Equation  2.21. 

Tha  bound  in  Equation  2.23  can  ba  is^rovad  by  obtaining  " j 

a battar  lowar  bound  for  EfT^otal^*  **•  *»y  ! 

first  considaring  tha  tiaa  raquirad  for  M busy  cycles  of  a 
gradual  input  gueua  with  an  infinite  buffer.  The  total  time  | 

will  ba 

*^*total ^infinite  " ”^®^^bp^inflaita*^^^idle^^ 

IS.  IM  th.  taa,  .«  b«for.  ud 

is  a standard  result  for  an  M/G/1  quaue  that  follows  from 
tha  analogy  discussed  in  Section  2.1.1.  Therefore 

*^*total^ infinite  calculated  exactly. 

% 

■ow  note  that  a gradual  input  queue  with  a finite 
buffer  has  the  same  busy  periods  as  a queue  with  an 
infinite  buffer,  except  when  there  are  overflows.  Therefore, 


wh*r«  la  tha  expacted  langth  by  which  busy  pariods 

with  ovarflows  ara  shortanad  dua  to  tha  overflows.  Using 
equation  2.22  again  gives 


bp  infinite 


bp  infinite 


^ uppex  owunuea* 

Bowavar,  as  ^^*0,  this  is  not  important  because  then 

®^^lost^  also  -►O.  Setting  zero  therefore 

gives  accurate  results  if  is  small.  Results  obtained  by 
using  Equations  2.23  and  2.24  for  tha  two  input  example 
eonsidarad  previously  in  this  section  ara  given  in  Table  2.4 


TABLE  2.4 

X^>war  Bounds  on  E{Tg^}  for  a Two  Input  Gradual  Input  Queue 

Input  Mean  on  Tima  • 1 

Ii^ut  Mean  off  Tima  * 3 

Buffer  size  Upper  bound  on 
(1  unit  ■ 1 Pr (overflow) 

■ean  input 
os  time) 


Lower  bound  on  Lo%rer  bound 
E(Toc>  on  eCTq^} 

(Eq.2.23)  (Eq.  2.24) 

with  P..E{T- 


2.2.4  OthT  ovrflow  measures 


P 

Zt  is  o£  interest  to  obtain  more  detailed  overflow 
statistics  than  just  the  probability  of  at  least  one  over- 
flow event  in  a busy  period.  One  statistic  that  is  of 
interest  is  the  probability  of  another  overflow  in  a busy 
period/  given  that  there  has  already  been  at  least  one  in 
that  busy  period.  This  probability  can  easily  be  bounded 
if  one  considers  a sample  function  of  buffer  content  that 
shows  a buffer  overflow.  Such  a sample  function  is  depicted 
in  Figure  2.8.  As  shown/  a buffer  overflow  event  always 
ends  with  all  sources  being  off.  A simple  bound  on  the 
probability  of  there  being  another  overflow  in  the  same 
busy  period  is  therefore  given  by 


I 

I 


Pr (overflow  again  in  ■ overflow  has) 
this  busy  period  ' occtirred 


l-Pr(no  sources  come 
on  in  the  first; 
X time  units 
* after  previous 
overflow) 


1-e 


-AX 


X 

where  A « £ X. 

i-1  ^ 


Clearly/  if  no  sources  come  on  in  the  first  K time  units 
after  the  previous  overflow/  the  buffer  will  empty  and  there 
will  not  be  another  overflow  in  this  busy  period.  This  is 
only  an  upper  bound/  however/  because  even  if  a source  comes 
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I 


i 

i 

] 

i 

i 


! 


i 

I 


i 


All  inputs  off  St  this  tins 


t-  Tins 


Ssnpls  function  of  buffer  content  after  an 
overflow  in  a gradual  input  queue.  Capacity 
of  all  input  channels  and  the  output  channel 
is  one  unit  of  data/unit  time. 


on  in  tho  first  K tins  units  / that  inflow  period  need  not 
eauss  buffer  overflow.  This  is  a very  sinpls  bound  that  is 
weak  if  the  buffer  size,  K,  is  large.  Therefore  it  is  worth- 
while to  improve  it. 

The  improvement  of  the  upper  bound  for  the  probability 
of  another  overflow  also  follo«rs  from  Figure  2.8.  Assume 
that  a source  comes  on  at  time  Now  note  that  from 
ttntil  tj*  the  buffer  content  stays  above  K-Xj^.  The  behavior 
of  the  buffer  content  above  K-Xj^  during  this  period  is  the 
sasM  as  the  behavior  of  the  buffer  content  dxiring  a busy 
period  for  a gradual  input  queue  with  buffer  size  x^^.  Since 
x^  * t^,  it  follows  that 

Pr (overflow  again  in  . overflow  has) 
this  busy  period  ■ occurred 


< 1 - Pr(no  sources  come  on  in  the 
first  K time  units  after 
previous  overflow) 

X 

“ / Aa"^^l  Pr (overflow  in  buffer  )j. 

busy  period  size-tj^  ®^1 

• i-e'A* 

* -At 

- / Aa  " 1 Pr (overflow  in  buffer)  . 

busy  period  size^t^®^! 
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(Xq.2.25) 


Saw  a lo%r«r  bound  for  Pr  (overflow) , (such  as  Equation  2.19), 
can  be  used  in  Eqpiation  2.25  to  complete  the  upper  bound. 
Equation  2.25  is  an  upper  bound  because  after  t2»  there  could 
be  the  start  of  another  inflow  period  during  which  the  buffer 
could  overflow.  The  next  inflow  period  after  t2  can  be 
thought  of  as  starting  a busy  period  for  a queue  with  btiffer 
size  X2>  By  recognizing  this  pattern,  it  is  possible  to 
izqprove  the  bound  given  in  Equation  2.25  by  considering  the 
possibility  of  more  than  one  inflow  period  occurring  in  the 
remaining  busy  period.  The  above  bounding  idea  will  be  used 
in  Chapter  4 to  study  flow  control  problems. 

It  is  also  of  interest  to  obtain  the  distribution  of 
the  quantity  of  data  that  is  lost  in  eui  overflow  event.  This 
can  be  done  for  two  input  gradual  input  queues  by  developing 
a continuous  time  Markov  chain  that  represents  the  overflow 
event.  For  example,  consider  the  queue  shown  in  Figure  2.9a. 
Mhen  an  overflow  even  starts,  both  inputs  must  be  on.  The 
buffer  content  then  remains  at  its  maximum  level  K until 
both  inputs  are  off  for  the  first  time.  During  the  overflow 
event,  data  is  lost  whenever  both  inputs  are  on.  The  Harkov 
chain  in  Figure  2.9b  represents  this  overflow  process.  The 
distribution  of  the  amount  of  data  lost  is  the  distribution 
of  the  time  spent  in  state  1 of  the  chain  before  trapping 
in  state  4,  given  that  the  starting  state  is  1. 


Ch.i 


n^l  IHt- 


On-tia«s  exponentially  distributed. 

^ Mean  » 

^ Sff*- times  exponentially  distributed. 

Mean  - ' 


Output  Chamnel 


wurni 


Buffer  size  K. 
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b.  Markov  ehaini representation  of  the  overflow 
event. 


PZ6URE  2.9  - Obtaining  the  distribution  of  the  quantity  of 
data  lost  in  an  overflow  event. 


L«t  H*(s)  be  the  Laplace  transform  of  the  time  spent  in 
■tate  1 during  one  visit  to  that  state.  Similarly,  let  L*(s) 
be  the  transform  of  the  distribution  of  the  amount  of  data 
lost  in  an  overflow  event.  For  this  example  W*(s)»2u/{s+2u) . 
By  noting  that  whenever  leaving  state  1,  state  4 will  be 
reached  without  returning  to  state  1 with  probedsility 
It  can  be  seen  that 

!,♦(.)  -Jo 

S+iu  'y+X'  ^0.0  'u^ 

Therefore  the  amount  of  data  lost  is  exponentially  distributed 
with  mean  (u<t>X)/2y^. 

Markov  chain  representations  for  overflow  events  of 
gradual  input  queues  with  more  than  two  inputs  can  also  be 
developed.  Unfortunately,  overflow  events  in  these  queues 
can  start  with  different  numbers  of  inputs  on  and  determination 
of  the  probability  of  starting  in  each  different  input  state 
is  a difficult  unsolved  problem.  Without  these  starting 
probabilities  the  Markov  chain  representations  cemnot  be 
used  to  determine  the  distribution  of  the  eunount  of  data 
lost  in  an  overflow  event.  Of  course  one  can  upper  bound 


th«  losa  by  assuming  the  maximum  number  of  inputs  on,  but 
this  may  not  be  a very  tight  bound. 

2.3  Comparison  of  the  Gradual  Incut  Queue  and  the  M/M/1  Queue 

The  gradual  input  queue  accounts  for  a finite  input 
rate  and  a finite  number  of  sources  while  the  M/M/1  queue  does 
not.  This  section  discusses  the  single  stage  queueing  effects 
that  this  allows  one  to  observe  that  cannot  be  seen  using  the 
M/M/1  queue. 

Perhaps  the  clearest  picture  of  the  differences  between 

the  two  queueing  models  can  be  obtained  by  examining  the 

expected  maximvun  buffer  content  during  a busy  period,  EtV  ], 

ni&x 

for  queues  with  infinite  buffers.  Figure  2.10  shows  E[V  ] 
for  the  M/M/1  queue  imd  several  gradual  input  queues.  In 
this  figure,  three  differences  between  the  two  types  of  queues 
can  be  observed.  These  are  denoted  by  D^,  D2/  and  on  the 
graph. 

The  first  difference,  0^,  is  the  difference  between  an 
M/M/1  queue  and  a gradual  input  queue  with  an  infinite  number 
of  input  channels.  The  difference  0^  is  eq\ial  to  the  mean 
length  of  one  message . This  results  from  the  difference 
between  instantaneous  input  (the  M/M/1  queue)  emd  gradual 
input.  This  difference,  as  well  as  0^  and  0^,  is  independent 
of  the  on  tim*  distribution  for  the  gradual  input  queue. 
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The  differences  0^  represent  the  changes  in  queueing 
with  different  numbers  of  input  channels.  As  the  graph  shows, 
the  fewer  input  channels  there  are,  the  less  the  queueing. 

This  is  because,  with  a finite  number  of  input  channels, 
when  some  of  them  are  on,  there  is  less  remaining  traffic 
Intensity.  The  remaining  traffic  intensity  referred  to  here 
is  the  rate  at  which  additional  inputs  can  come  on  and  add  to 
the  buffer.  When  there  are  a large  number  of  channels, 
having  a few  of  them  on  does  not  decrease  the  remaining 
traffic  intensity  much.  However,  if  there  are  few  inputs 
to  begin  with,  having  some  of  them  on  can  greatly  reduce 
this  traffic  intensity.  Another  way  of  thinking  about  this 
phenomenon  is  that  the  finite  rate  channels  terd  to  reduce 
the  burstiness  of  the  data  arrival  process  and  the  fewer 
input  channels  there  are,  the  more  the  burstiness  is  reduced. 
This  effect  cannot  be  seen  using  the  M/M/1  queue. 

Another  phenomenon  that  can-  be  seen  with  the  gradual 
input  q\ieue  is  the  effect  of  unequal  traffic  on  the  input 
channels.  The  greatest  queueing  occurs  when  all  channels 
carry  the  same  amount  of  traffic.  If  they  carry  different 
amounts  of  traffic,  the  quexieing  is  reduced  as  shown  by 
difference  0^.  This  is  easy  to  understand  when  one  remembers 
that  if  all  the  traffic  were  on  one  input  channel,  there 
would  be  no  queueing  at  all.  Again  this  effect  cannot  be 
seen  using  the  simpler  M/M/1  queue. 
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Tbtt  effects  discussed  above  can  also  be  seen  in  other 
performance  measures.  Figure  2.11  shows  the  effect  of 
different  numbers  of  input  channels  on  the  upper  bound  for 
Pr (overflow) . The  same  upper  bound  is  also  given  for  the 
M/M/1  queue  as  a reference.  Again » the  amount  of  queueing 
increases  with  the  number  of  input  channels. 

Figure  2.12  shows  a graph  of  the  expected  delay  per  bit 
for  the  M/M/1  queue  and  bounds  on  this  delay  for  a two  input 
gradual  input  queue.  The  gradual  input  queue  has  less  delay 
than  the  M/M/1  queue.  Note  that  at  low  utilizations  the 
gradual  input  queue  has  essentially  no  delay.  This  is  because 
In  this  region  of  operation,  nearly  all  busy  periods  consist 
of  one  input  channel  on  period  which  flows  through  the  qxteue 
with  no  buffer  buildup.  The  M/M/1  queue  with  its  instan- 
taneous input,  however,  always  has  at  least  0.5  message 
lengths  of  expected  delay  per  bit. 

Finally,  Figure  2.13  compares  E[V ] for  two  input 

gradual  input  queues  with  several  different  input  capacities 
with  for  an  M/M/1  queue.  As  the  input  capacity  of 

the  two  input  queue  is  increased,  the  expected  buffer 
buildup  also  increases.  In  the  limit  of  infinite  input 
capacities,  the  two  input  queue  behaves  the  same  as  the 
N/M/1  queue  because  then  the  effects  due  to  finite  input 
rates  no  longer  exist. 
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FIGURE  2.12  - Expected  D«lay  Par  Bit.  Both  Queues  have 
naan  input  on  times,  ■ 1. 
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Output  Channel  Utilization 

FIGURE  2.13  - for  different  input  channel  capacities. 

'All  input  on  times  are  scaled  so  that  the. 
expected  length  of  an  input  • 1 unit  of  t’me  on 
the  output  channel. 


In  aunmary,  th«  three  effects  observable  with  a single 
' gradual  input  queue  are 

1*  Effect  of  nonins  tan  temeous  input. 

2.  Effect  of  a finite  number  of  inputs. 

3.  Effect  of  inputs  with  different  traffic  loads. 
*^^®cts  are  especially  interesting  when  the  queue  is 

® network.  The  next  chapter  considers  networks  of 
gradual  input  queues  and  it  will  be  shown  that  in  the  network 
context,  even  more  details  csm  be  seen  that  are  not  apparent 
with  the  M/M/1  qxieue. 


CHAPTER  III  > NETWORKS  OF  GRADUAL  INPUT  QUEUES 

This  chapter  deals  with  the  analysis  of  buffering 

% 

requirements  in  a network  of  gradual  input  queues.  The 
network  of  queues  represents  a message  switched  communication 
network  in  which  static  routing  is  being  used.  The  reqtiired 
analysis  cannot  be  done  exactly / so  the  approximations  used 
are  first  presented.  Several  network  examples  are  then 
given.  The  exan^les  illustrate  the  special  insights  into 
network  operation  that  can  be  obtained  using  the  gradtial 
input  model.  Finally,  the  problem  of  optimizing  the  static 
routing  is  briefly  discussed. 

3.1  Approximations  for  the  Analysis  of  a General  Network 

3.1.1  Traffic  streams  in  general  networks 

The  gradual  input  queue  representation  of  a message 
switched  communication  network  consists  of  several  basic 
elements.  These  include  the  network  topology,  the  stochastic 
description  of  the  input  traffic,  the  routing  policy  and  any 
other  mechanisms  such  as  flow  control  rules.  Figxire  3.1 
illustrates  these  elements.  The  network  topology  consists 
of  directed  COTmunication  channels  which  interconnect  a set 
of  nodes.  In  this  chapter,  the  comamnication  capacities  of 
all  channels  will  be  assumed  to  be  identical  and  normalized 
to  1.  Having  identical  channel  capacities  allows  one  to 
Vply  the  analysis  for  a single  stage  developed  in  Chapter  2. 
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Ch.l  ich.2  IChil  |Ch.2  I off  f Ch.l 


touting 


Input  to 
Node  2 
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(Channel  1) 


Typical  Switched  traffic  sequence. 


FIGURE  3.1  **  Traffic  stre£uns  in  a network  of  queues. 


Th«  input  traffic  to  the  network  also  arrives  on  channels 
of  capacity  1.  This  traffic  is  in  the  form  of  alternating 
renewal  processes  euid  the  mean  on  time  for  all  Inputs  will 
be  tiUcen  to  be  equal  to  An  on  time  on  an  input 

channel  represents  one  message  and  this  message  will  be  kept 
intact  as  it  pakses  through  the  network.  The  path  that  the 
message  takes  is  determined  by  the  routing  policy.  The 
routing  policy  considered  here  is  a static  policy  which 
routes  fixed  fractions  of  the  traffic  between  any  source  and 
destination  over  specific  paths.  This  is  implemented  by 
random  s2UDpling  at  the  switching  points  with  the  sampling 
probabilities  being  the  fixed  fractions  in  the  routing  policy. 
Such  a routing  policy  is  the  same  as  the  one  introduced  by 
Klnlarock  [KLEIN  64]  in  his  study  using  a network  of  M/M/1 
queues.  The  final  network  element,  flow  control  mechanisms, 
will  not  be  used  in  this  chapter.  It  will  be  assumed  that 
the  traffic  is  allowed  to  flow  freely  through  the  network 
with  no  controls  to  reduce  or  distribute  congestion.  The 
goal  of  this  chapter  is  to  analyze  the  buffering  requirements 
for  a network  such  as  described  above,  subject  to  a probability 
of  buffer  overflow  constraint. 

In  Chapter  2 it  was  pointed  out  that  the  analysis 
currently  available  for  gradual  input  queues  requires  that 
the  traffic  on  the  input  channels  be  independent  alternating 
renewal  processes  with  exponentially  distributed  off  times. 
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This  requirement  can  easily  be  met  by  assumption  for  input 
channels  which  carry  traffic  directly  from  sources  outside 
the  network.  Inside  the  network,  however,  this  requirement 
cannot  be  met  in  general.  First,  traffic  on  2 different 
internal  buffer  input  channels  may  be  correlated  because  it 
previously  passed  over  a common  channel.  For  this  to  happen, 
however,  the  traffic  must  have  passed  through  at  least  one 
intermediate  node  since  it  was  on  a common  chauinel.  There- 
fore some  of  the  correlation  will  be  reduced.  Here  it  will 
be  assumed  that  all  traffic  streams  are  independent . f 

The  exponential  off  time  requirement  also  caiuiot  be  met 
in  general.  An  example  that  illustrates  this  is  the  small 
network  shown  in  Figure  3.1a.  The  traffic  into  the  node  2 
buffers  does  not  consist  of  alternating  renewal  processes 
with  exponential  off  times.  This  is  because  of  the  routing 
done  by  the  switch.  The  off  times  in  the  traffic  streams 
after  the  switch  are  no  longer  exponential  and  independent 
of  all  other  on  and  off  periods  because  some  of  the  off 
periods  are  caused  by  the  removal  of  messages  from  the  busy 
period  of  the  previous  stage.  This  is  illustrated  in 
Figure  3.1b. 

The  above  difficulty  relating  to  internal  traffic 

streams  will  be  dealt  with  by  using  an  approximation.  All 

traffic  from  external  sources  will  be  taken  to  have  both  on 

tSee  Section  1.2  for  a discussion  of  how  this  relates  to 
the  Kleinrock  (KLEIN  64]  independence  assumption. 
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and  off  times  exponentially  distributed.  Then  it  will  be 
assumed  that  all  traffic  streauns  in  the  network  are  therefore 
alternating  renewal  processes  with  exponential  on  and  off 
times.  The  use  of  this  approximation  is  supported  both  by 
two  limiting  cases  discussed  below  in  which  the  approximation 
becomes  exact,  and  by  the  simulation  results  given  in 
Section  3.1.4. 

The  first  limiting  case  in  which  traffic  streams  in  a 
general  network  approach  alternating  renewal  processes  with 
exponentially  distributed  on  and  off  times  is  when  the 
utilization  of  the  output  channels  of  all  buffer  stages  is 
near  zero.  This  can  be  shown  by  first  considering  a buffer 
atage  at  which  none  of  the  input  traffic  has  been  switched 
(sampled) . Since  the  output  chaimel  utilization  is  near 
aero,  all  busy  periods  on  that  channel  will,  with  high 
probability,  involve  only  one  message.  Therefore,  with 
high  probability,  the  traffic  streams  on  the  output  chauinel 
will  consist  of  an  alternating  renewal  process  of  the  form 
sho%m  in  Figure  3.2a.  The  exponential  off  times  in  this 
stream  follow  from  the  assumption  that  none  of  the  input 
streams  to  this  stage  were  switched. 

NOW  note  that  when  a stream  of  the  form  shown  in  Figure 
3* 2a  is  sampled,  the  resulting  traffic  stream  again  has  on 
periods  that  consist  of  only  one  message.  Therefore,  if  the 
length  of  a message  is  exponentially  distributed,  the 
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FIGURE  3.2  - Traffic  streams  In  a network  with  utilization 
near  zero . 
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distribution  of  the  on  times  of  the  sampled  stream  will 
.approach  an  exponential  when  the  utilization  of  all  channels 
is  near  zero.  The  remaining  problem  is  to  determine  the 
distribution  of  the  off  time  periods  in  the  s«unpled  stream. 
This  can  be  done  as  follows.  Let  B* (s)«u/(u-i-s)  be  the  Laplace 
transform  of  the  length  of  a single  message  and  A* (s)*l/ (X+s) 
be  the  Laplace  transform  of  the  length  of  an  off-time  in  the 
unsampled  stream.  The  traffic  stream  is  sampled  at  random 
with  a prob2ibility  z of  keeping  a message  in  the  stream  of 
interest.  Therefore  the  Laplace  transform  of  the  off-time 
distribution  for  the  seunpled  stream  is  given  by 

A*(s}  - r Z(l-2)“"^  (A*(s))“ 
saa^led  n«l 

m 

- r 2(1-Z)““^  {X/(X+S))"  (u/(u+s))"“^ 
n«l 

_'z(X/(X+s))  . > . , . , 

(Va+5))(u/(u+s))  s-min{-X,-u} 

(Eq.3.1) 

The  condition  that  the  utilization  factor  on  the  output 
channel  be  near  zero  implies  that  X”^  >>  u”^.  Therefore 
Equation  3.1  can  be  approximated  by 


A*(s) 

sampled 


z(X/(X+s)) 

r^^r-zi 'a'/uvsi ) 


distribution  of  the  on  times  of  the  sampled  streeun  will 
approach  an  exponential  when  the  utilization  of  all  channels 
is  near  zero.  The  remaining  problem  is  to  determine  the 
distribution  of  the  off  time  periods  in  the  sampled  stream, 
niis  can  be  done  as  follows.  Let  B*  (s)»uKu*f-s)  be  the  Laplace 
transform  of  the  length  of  a single  message  and  A* (s)*X/ (X-t-s) 
be  the  Laplace  cransform  of  the  length  of  an  off -time  in  the 
unsampled  stream.  The  traffic  stream  is  sampled  at  random 
with  a probability  z of  keeping  a message  in  the  stream  of 
interest.  Therefore  the  Laplace  transform  of  the  off-time 
distribution  for  the  sampled  stream  is  given  by 


A*(s)  - E z(l-z)""^ 
saiiq>led  n«l 

• . 

- E zd-z)®*-^ 
n*l 


(A*(s))“  {B*(s))““^ 
(X/(X+8))"  (u/(u+s))""^ 


'z(X/(X+s)) 

l-(l-Z)  (X/(A+S)  ) (u/(U+8)  ) 


s-min{-X ,-u} 


(Bq.3.1) 


The  condition  that  the  utilization  factor  on  the  output 
channel  be  near  zero  implies  that  x'^  >>  u~^.  Therefore 
equation  3.1  can  be  approximated  by 


A*(s) 

sasqiled 


z(X/(X.t.s) ) 

l-(l-z)  (A/(A+s)) 
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(Eq.3.2) 


Tills  states  that  the  distribution  of  off  times  is  approximate 
ly  exponential  at  utilizations  near  zero.  Therefore ^ pro- 
ceeding step  by  step  through  a network,  starting  with  stages 
whose  inputs  eu:e  not  switched,  one  can  show  that  at  each 
stage  the  distribution  of  off  times  approaches  an  exponential 
distribution. 

The  second  case  that  gives  exponential  off  times  is 
when  the  utilization  factor  of  all  stages  in  the  network  is 
near  one.  In  this  case,  the  output  traffic  streams  are 
dominated  by  long  busy  periods  consisting  of  many  individual 
messages.  This  is  shown  in  Figure  3.3a.  The  sampled  stream 
can  therefore  be  thought  of  as  being  derived  from  one 
continuous  succession  of  messages  with  a length  distribution 
whose  Laplace  transform  is  again  B* (s)«u/(u+s) . Again  assume 
that  a message  is  kept  in  the  sampled  stream  with  probability 
z.  Then  the  Laplace  tramsform  of  the  off-time  distribution 
for  the  sampled  stream  is 

A*(s)  • r z(l-z)"“^  (B*(s))" 
sampled  n*l 

■ 

su-fs 

similarly,  the  Laplace  transform  of  the  on-time  distribution 
for  the  sampled  stream  is 


r 


b*  Sampled  message  stream 


PZGUltE  3.3  - Traffic  streams  in  a network  with  utilization 
near  one. 
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B*  (s) 


- Z (l-2)z”“^(B*(s))" 
n*l 

. (l-z)u 

(l-z)u+s 

Therefore # both  the  on  and  off  times  approach  an  exponential 
distribution  in  this  case  as  well. 

In  summary / these  two  limiting  cases  support  the  use  of 
the  approximation  that  all  traffic  streams  in  a network  are 
alternating  renewal  processes  with  exponential  on  wd  off 
times  when  the  source  traffic  strecims  are  of  this  type.  This 
approximation  will  be  used  throughout  this-  chapter.  Now  that 
the  basic  natxire  of  the  traffic  streams  has  been  specified, 
the  meaii  on  and  off  times  associated  with  them  must  be 
calculated.  The  next  section  addresses  the  problem  of 
determining  the  mean  on  time  of  a switched  (sampled)  message 
stream.  The  following  section  then  shows  how  to  use  this 

' V , ■ 

result  to  find  all  mean  traffic  parameters  in  a network  of 
gradual  input  queues. 

3.1.2  Expected  on-time  for  a switched  busy  period 

The  one  system  element  not  analyzed  in  the  previous 
chapter  is  the  switch.  In  order  to  be  able  to  analyze  a 
general  network,  one  must  be  able  to  determine  the  expected 
on-time  of  the  busy  periods  at  the  output  of  the  switch.  The 
approach  taken  to  this  problem  is  first  to  calculate  the 
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•xpected  number  of  messages  in  a switched  busy  period.  Let 


denote  the  number  of  messages  in  such  a switched  busy 
period.  Then  the  expected  time  duration  of  the  busy  period 
will  be  approximated  by 


E{N  } 

E{Time  duration  ■ E{N  } 6.  ■ — - — (Eq.3.3) 

of  switched  s an  u 

busy  period } 


Where  is  the  expected  length  of  one  message.  This 

relationship  is  only  approximate  because  the  distributions 
for  the  number  of  messages  and  the  message  lengths  in  a busy 
period  are  not  independent. 

First  some  analysis  of  an  unswitched  busy  period  will  be 
done.  Le.t  E(N  } be  the  expected  number  of  messages  in  an 

\X8 

unswitched  busy  period.  Now  consider  picking  one.  message  at 
random  from  such  a stream  of  messages . The  probability  that 
the  message  chosen  is  the  last  one  in  a busy  period,  Pr(last 
message}^,  is  given  by 


Pr(Last  message)^ 


r — Pr (length  of  busy  period 
n*l  ^ from  which  message  is 
.chosen  ■ n) 


n Pr (length  of  busy  period»n) 

E?N_r 


us 


■ 


(Eq.3.4) 
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The  expression  for  Pr (length  of  busy  period  from  which  message 
is  chosen  « n)  follows  from  the  fact  that  the  message  is 
being  chosen  by  random  incidence  [DRAKE  67] . 

Equation  3.4  also  applies  to  a switched  message  stre^lm, 

i.e.  f 

Prdast  message)^  ■ ^ (Eq.3.5) 

8 

Where  Prdast  message)  is  again  the  probability  that  a 
message  chosen  by  random  incidence  is  the  last  one  in  a busy 
period.  The  switched  stream  is  of  course  derived  from  an 
unswitched  one  and  therefore 

Prdast  message).  > Pr(last  message),,. 

8 \2S 

t d-PrClast  message)  )Pr (message 

^ following 
chosen  one 
is  not  in 
switched 
stream  of 
Interest) 

The  above  states  that  the  last  message  in  a busy  period  in 
a switched  busy  period  was  either  the  last  message  in  the 
unswltched  busy  period  or  it  became  the  last  message  because 
the  message  immediately  behind  it  was  switched  to  another 
stream.  Let  z be  the  probability  that  a message  is  switched 
into  the  stream  of  interest.  Then  using  Equations  3.4  and 
3.S  in  the  above  relation  gives 
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+ (l-E{N^jg}”^)  (1-z) 

- * + 1 - Z 

or 

UE{N^)“^  - ZWE{N^}“^  + U(l-z)  (Bq.3.6) 

Roeolling  Equation  3.3#  it  can  be  seen  that  there  is  a linear 
relationship  between  the  inverses  of  the  expected  time 
durations  of  the  busy  periods  at  the  input  and  output  of  a 
switch.  This  result  will  be  useful  in  the  next  section 
irhere  the  mean  traffic  parzuneters  in  a general  network  are 
determined. 

3.1.3  Determining  the  mean  traffic  parameters  in  a ceneral 
network 

A general  network  of  queues  consists  of  N nodes 
% 

(indexed  i«l#2...N}.  Figure  3.4  gives  a detailed  view  of 
one  of  these  nodes.  As  shown#  each  node  has  one  or  more 
directed  output  communication  channels  (indexed  j«l#2. . . jmax^). 
A buffer  is  associated  with  each  output  channel  and  it  is  fed 
by  one  or  more  internal  node  channels  (indexed  k«l#2. .kmax^^) . 
The  internal  channels  either  carry  traffic  that  has  been 
switched  from  network  channels  or  traffic  from  source  channels 
outside  the  network. 
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It  is  possible  to  uniquely  identify  each  communication 
channel  in  the  network  by  using  the  labeling  convention 
given  above.  Output  channels  are  identified  by  a number 
pair  (i,j)  while  internal  channels  are  identified  by  three 
numbers  (i,j,k).  The  mean  on  and  off  times  on  each  of  these 
types  of  channels  will  be  denoted  by  8.  8.  ^ and 

^ i/j 

^i»j»k  Similarly,  the  utilizations  of  internal 

and  output  channels  will  be  u.  . . 2md  u.  . respectively. 

These  utilizations  are  defined  as  follows. 


u 


i,j.k 


» j »k  i,  j ,k 


(Eq.3.7) 


kmaxi  . 

i»j»k 


(Eq.3.8) 


Here,  as  elsewhere,  it  is  implicitly  assumed  that  the 
capacities  of  an  internal  and  an  output  channel  are  the  same. 
Eqtiation  3.7  states  that  the  utilization  of  a channel  is  the 
fraction  of  time  that  it  is  on.  Equation  3.8  states  that  the 
utilization  of  an  output  channel  equals  the  stun  of  the 
utilizations  of  the  associated  internal  channels . 

The  problem  now  is  to  solve  for  the  mean  parameters  8 
and  A everywhere  in  the  network.  This  can  be  done  by  first 
solving  for  the  utilizations  u and  then  for  the  mean  on  times 
8*  The  mean  off  times  can  then  be  found  using  equations 
like  Equation  3.7. 
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The  utilizations  in  a general  network  of  gradual  input 
queues  can  be  found  by  solving  a set  of  linear  equations.  In 
this  set,  the  utilizations  for  source  channels  are  assumed  to 
be  given.  The  utilizations  for  output  channels  are  given  by 
linear  eqiiations  of  the  form  of  Eqxiation  3.8.  Finally,  the 
utilization  of  a switched  internal  channel  equals  the  utiliza- 
tion of  the  soxuce  output  channel  times  the  fraction  of 

traffic  switched  to  that  internal  channel.  If  z ...  is 

m,i,3 ,K 

the  fraction  of  traffic  switched  from  output  channel  (m,i)  to 
internal  channel  (i,j,k),  then 


''i,j,k  * ^'*m,i^  ^*m,i,j,k^ 


(Eq.3.9) 


These  individual  utilizations  can  be  combined  into  one  matrix 
equation. 


0 ) 

1 

”int" 

11. . .10. . .01 
* • . ‘0 
0...01...1| 

m m 

^out 

(Eq.3.10) 


In  this  equation,  Z is  the  routing  matrix  of  the  fractions 
4 4 V while  U . _ . and  I?  . are  vectors  of  internal  and 

XAw  OUw 

output  channel  utilizations  respectively. 


101 


Equation  3.10  may  or  may  not  have  a solution.  Even  if 
there  is  a solution,  the  result:? ng  utilizations  may  be  larger 
than  one.  These  two  points  are  illustrated  in  Figure  3.5. 
Figure  3.5a  shows  a network  for  which  Equation  3.10  has  no 
solution.  The  problem  is  that  an  infinite  amount  of  traffic 
accxunulates  inside  the  network.  The  utilization  equation  for 
the  network  in  Figure  3.Sb  has  a solution,  but  the  utilization 
U2  is  larger  than  one.  In  this  case  Equation  3.8  is  being 
used  in  a region  where  u.  . > 1.  Equation  3.8  is  not  valid 
in  this  region  and  furthermore  utilizations  greater  than  one 
are  physically  not  possible.  By  physical  reasoning,  one  can 
see  that  in  this  case  there  would  also  be  an  infinite 
accumulation  of  traffic  inside  the  network.  In  this  study 
only  networks  which  have  a steady  state  distribution  of 
buffer  contents  are  of  interest  and  this  occurs  only  if 
Equation  3.10  has  a solution  with  all  utilizations  < 1. 

The  remaining  problem  now  is  to  solve  for  the  mean  on 
times  8 everywhere  in  the  network.  This  is  simplified  by 
solving  for  the  reciprocals  § « because  the  S's  obey  a 
set  of  linear  equations.  As  with  the  utilizations,  there  is 
one  type  of  equation  that  relates  S's  on  the  two  sides  of  a 
switch  and  one  that  relates  the  §'s  on  the  two  sides  of  a 
buffer. 

The  relationship  between  the  8's  on  both  sides  of  a 
switch  follows  directly  from  Section  3.1.2.  Recall  that 
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•xternal 

soiorce 


A-  Uj^+u^-u^ 


B.  U2+U3*U4 

Therefore  u_*u,-u- 
3 4 2 

Therefore  no  solution 


external 

source 


a.  A case  in  which  Eq.  3.10  has  no  solution. 


b.  A case  in  which  the  utilization  Eq.  3.10 
has  a solution / but  not  all  utilizations 

are  < 1. 


FIGURE  3.5  - Networks  for  which  Eq.  3.10  does  not  give 
physically  meaningful  results. 


' and 


6,  - E{N^}  (Bq.3.12) 

wfaara  y ^ is  the  expected  length  of  one  message  and  E{N}  is 
the  ejected  nximber  of  messages  in  a busy  period.  The 
subscripts  ^ Md  ^ refer  to  unswitched  (input  to  the  switch) 
and  switched  (output  from  the  switch)  streams  respectively. 
Taking  the  inverses  of  Equations  3.11  and  3.12,  one  can 
substitute  directly  into  Equation  3.6  and  obtain  the  result 
that 

* 

, B,  - * 8^  u(l-*) 


Using  the  indexing  convention  for  communication  channels,  this 
becomes 


®m,i  *m,i,j,k  ^ ^^“*m,i,  j,k^ 


(Eq.3.13) 


Now  the  linear  relationship  for  the  B's  on  both  sides  of 
a buffer  will  be  found.  First  recall  the  relationship  for 
output  channel  utilisation 
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> 

t . 

This  can  be  rearranged  to  give 


or 


{ 3J.) 


(Bq.3.14) 


A similar  relationship  exists  for  the  input  channels  of  the 
buffer. 


if  J f Jv 


(Eq.l.lS) 


Equations  3.14  and  3.15  can  be  tied  together  by  recognizing 
that  for  a gradual  input  queue 


Jc-l 


(Eq.3.16} 


Equation  3.16  states  that  the  rate  at  which  off  periods  on 
the  output  channel  end^  is  equal  to  the  sum  of  the 

rates  at  which  off  periods  end  on  the  input  channels.  This 
is  true  since  the  off  periods  on  the  input  channels  are 
assumed  to  be  exponentially  distributed.  Combining  Equations 
3.14»  3.15  and  3.16/  one  obtains  the  linear  relationship 
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h,i  * '• 


1-U 


u 


iii' 


i.j 


Janax.  . 

t "-'J  s 

k«l 


i,j,k  <17 


IkUL 

‘i»j/k 


■) 


(Eq.3.17) 


Sine*  the  utilizations  ^ and  j have  previously  been 
determined,  the  8's  can  now  be  obtained. 

Eqxiations  3.13  and  3.17  can  also  be  written  as  one 
matrix  equation  as  follows. 


• 

m m 

1 

“ 1 

z 

Lt 

^“Vi,j,k 
^ Vi,j,k 

“c' 

1 

0 

0 

— 

— - 

— — 

(Eq.3.18) 


The  matrix  is  the  matrix  of  coefficients  implied  by 

Equation  3.17.  The  matrix  Z is  again  the  routing  matrix 

A * 

while  and  6^^^  are  vectors  of  reciprocal  expected  on 

times  for  internal  euid  output  channels  respectively. 

The  remaining  question  is  how  to  solve  this  set  of 
eqiiations.  The  author  has  found  that  Picard  iteration  is  a 
particularly  convenient  way.  This  follows  from  the  fact  that 
Equation  3.18  is  of  the  form 


Q(§)  - B 


(Eq.3.19) 
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If  certain  requirements  are  met,  this  can  be  solved  by  an 
' iteration  scheme  (Picard  iteration)  of  the  form 


0<®n>  - 


n ■ 1#2, . . . . 


Prom  the  contraction  mapping  theorem  [OESOER  75]  it  is  known 
that  this  iteration  scheme  will  converge  to  the  unique 
solution  of  Equation  3.19  if 


llQ(Bl)  - 0(02)11  < <=\\^i  - 82I 


where  c < 1 and  0^  and  points. 

Examining  Equation  3.18  it  cem  be  seen  that  this  will  be  true 

0 J 

if  the  largest  eigenvalue  of  the  matrix  is  < 1. 


This  matrix  contains  only  positive  elements.  Therefore  if 
% 

the  sum  of  the  elements  in  each  row  is  < 1,  the  largest 

eigenvalue  will  also  be  < l.t  This  will  be  the  case  if 

there  is  switching  and  combining  in  buffers  at  each  node  of 

the  network.  If  there  is  switching,  each  row  of  the' matrix 

7 will  have  a sum  <1.  If  there  is  combining  in  each  buffer, 

then  there  will  be  at  least  two  nonzero  j for  each 

buffer.  Therefore  the  row  sums  of  U will  be 

c 


See  the  Appendix  on  positive  matrices  in  Karlin  and 
Taylor  (KARL  75]. 
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This  section  presents  simulation  results  that  support 
the  use  of  the  approximation  that  all  traffic  streams  in  a 
general  network  of  gradual  input  queues  are  alternating 
renewal  processes  with  exponentially  distributed  on  and  off 
times.  Section  3.1.1  showed  that  this  approximation  becomes 
exact  when  all  channel  utilizations  are  near  zero  or  one. 

The  purpose  of  the  simulation  is  to  show  that  the  approxima- 
tion is  also  reasonable  for  other  utilizations. 

The  simulation  was  done  for  a queueing  system  as  shown 
in  Figure  3.6.  The  system  consists  of  a gradual  input  queue 
followed  by  a routing  switch.  The  inputs  to  the  system  are 
alternating  renewal  processes  with  exponentially  distributed 
on  and  off  times.  The  simulation  then  obtained  the 
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traffic 
stream  are 
obtained) 


FIGURE  3.6  " Gradual  input  queueing  system  studied  by 
simulation. 


109 


statistics  of  the  on  and  off  times  associated  with  the 
traffic  after  the  switch.  The  simulation  performed  was  a 
Monti  Carlo  computer  simulation  written  in  Fortran.  Random 
number  generators  from  the  International  Mathematics  and 
Statistics  Library  were  used  to  generate  s<unple  input  on  and 
off  times  as  well  as  the  routing  decisions  (random  sampling) 
that  occurs  in  the  switch. 

The  results  of  two  simulation  cases  are  summarized  in 

Figxires  3.7  to  3.10.  In  both  cases  the  mean  message  length 

is  one  euid  the  fraction  of  traffic  kept  in  the  steeun  of 

interest,  z,  is  0.5.  In  Case  1 the  utilization  of  the  output 

channel  of  the  gradual  input  queue  is  0.5  while  in  Case  2 it 

.is  0.8.  The  results  in  Figures  3.7  and  3.9  show  that  the 

approximations  used  in  this  chapter  are  good  for  calculating 

the  mean  on  and  off  times  for  the  switched  traffic  stream. 

Figures  3.8  and  3.10  give  histograms  of  the  sample  lengths  of 
% 

the  switched  on  and  off  times.  Also  shown  are  the  theoretical 
histograms  for  the  exponential  distributions  assimed  in  the 
approximations.  These  results  Indicate  that  the  exponential 
distribution  assumptions  are  indeed  reasonable  for  calculating 
traffic  stream  parameters  in  a general  network.  If  the 
requirement  that  buffer  input  traffic  streams  are  independent 
is  also  reasonably  met,  then,  using  these  traffic  parameters 
with  the  gradual  input  queue  will  give  good  results. 
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Expected  on  time 


a.  Expected  on  time  for  a switched  busy  period. 
Value  calculated  using  approximations-1 . 33 . 


Expected  off  time 


b.  Expected  off  time  for  a switched  traffic 
' stream.  Value  calculated  using 
approximations«4 . Q. 


FIGURE  3.7  - Simulation  results  Case  1.  See  text  for  details. 
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Expected  on  time 


e.  Expected  on  time  for  a switched  busy  period. 
Value  calculated  using  approximations*!. 67. 


Expected  off  time 


b.  Expected  off  time  for  a switched  traffic 
stream.  Value  calculated  using  approxi- 
mations* 2.  50. 


FIGURE  3.9  - Simulation  Results  Case  2.  See  text  for  details. 
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3.2  Examples  of  General  Networks 

The  examples  in  this  section  illustrate  the  use  of  the 
gradual  input  queue  to  study  the  buffering  requirements  of  a 
message  switched  network.  The  analysis  used  is  that  presented 
in  Section  3.1.  Where  Pr (overflow)  is  calculated,  the  upper 
bound  given  by  Equation  2.18  is  used.  The  results  are  com- 
pared to  those  obtained  when  using  the  network  of  M/M/1 
queues  model. 

The  first  three  types  of  examples  that  will  be  considered 
are  one  way  loop  networks,  a seven  node  network  with  four 
Hamiltonian  circuits  and  sections  of  an  ARPA  type  network. 
These  three  types  of  examples  are  illustrated  in  Figures  3.11 
to  3.13.  For  each  of  these  networks  it  will  be  assumed  that 
all  communication  channels  have  a capacity  of  one.  There  is 
one  source  (such  as  a host  computer)  at  each  node  and  this 
source  can  send  data  into  the  network  gradually  at  rate  one. 
The  input  traffic  from  these  sources  has  a mean  on  time 
It  will  be  assumed  that  when  traffic  reaches  its  destination 
node,  it  can  be  delivered  outside  the  network  without 
requiring  further  buffering. 

The  one  way  loop  examples  are  completely  symmetric. 

Each  input  is  the  same  and  each  node  sends  an  equal  amount  of 
traffic  to  each  of  the  other  nodes.  To  examine  the  effects 
of  loop  size,  3,5  and  10  node  loops  are  considered.  Table  3.2 
presents  the  important  network  parameters  for  the  exeunples. 


US 


Input  4 


FIGURE  3«11  — A fiva  noda  ona-v^ay  loop  network 
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Table  3.2 


Parameters  for  the  Loop  Network  Examples 
Por  all  cases  » 8^^^  ■ 1 


Number  of  nodes 

3 

5 

10 

Routing  peurameter  z 

0.333 

0.600 

0.800 

Case  1 

Loop  utilization  « 

*111 

0.2 

6.5 

11.5 

24.0 

®112 

1.038 

1.105 

1.171 

*112 

14.552 

8.105 

6.150 

Case  2 

Loop  utilization  » 

x-1 

111 

0.6 

1.5 

3.167 

7.333 

®112 

1.159 

1.472 

1.862 

-1 

' *112 

4.643 

2.618 

2.017 

Case  3 

Loop  utilization  > 

x'l 

*111 

0.9 

0.667 

1.778 

4.556 

®112 

1.361 

2.107 

3.514 

.1 

*112 

3.184 

1.795 

1.369 

Th«  cases  presented  give  network  operation  at  three  different 
utilizations,  0.2,  0.6  and  0.9.  A graph  of  the  Pr (overflow) 
vs.  buffer  size  for  the  utilization  « 0.6  case  is  given  in 
Figture  3.14. 

Two  effects  occur  in  these  loops.  First,  as  loop  size 
increases,  the  length  of  busy  periods  inside  the  loop, 
Increase.  This  tends  to  increase  queueing.  Second,  as  loop 
size  increases,  a larger  fraction  of  the  traffic  into  each 
node  arrives  over  one  channel  (the  internal  loop  channel) . 

This  tends  to  decrease  queueing.  Figure  3.14  shows  that  the 
first  effect  dominates  in  going  from  a 3 to  5 node  loop  while 
the  second  effect  dominates  in  going  from  a 5 to  10  node  loop. 

Note  that  these  effects  cannot  be  observed  using  the 
M/M/1  model.  The  M/M/1  model  always  indicates  the  same 
amount  of  queueing  for  a given  utilization,  no  matter  what 
the  size  of  the  loop.  The  M/M/1  curve  in  Figxire  3.14  there- 
fore applies  to  any  size  loop  operating  at  a utilization  of 
0.6. 

As  a second  example,  the  seven  node  network  in  Figure 
3.12  will  be  used  to  show  the  dramatic  effects  of  having 
gradual  inputs  for  the  sources.  The  traffic  in  this  network 
will  also  be  assumed  to  be  symmetrical.  The  routing  for  the 
traffic  is  illustrated  in  Figure  3.15,.  Note  that  each  charnel 
in  the  perimeter  Hamiltoniam  circuits  carries  traffic  from 
only  one  source.  Since  that  source  provides  a gradual  input 
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as  tha  communication  channel  capacity,  there  is  no  queueing 
on  these  channels!  The  only  channels  which  have  queueing  are 
the  Internal  Hauniltonian  circuits.  Each  of  these  are  gradual 
input  queues  with  two  inputs.  Figure  3.16  shows  the 
Pr (overflow)  vs.  buffer  size  for  these  channels  if  their 
utilization  is  0.2.  This  corresponds  to  each  network  having 
a utilization  of  0.6.  Figure  3.16  also  shows  the  curve  for 
the  M/M/1  model.  Using  the  M/M/1  model,  this  curve  would 
apply  to  all  channels  in  the  network  since  they  all  have  a 
utilization  of  0.2. 

In  these  first  two  examples,  the  sources  were  considered 
to  be  host  computers.  They  could  also  have  been  the  outputs 
of  concentrators  which  have  gathered  traffic  from  many 
terminals.  The  concentrator  would  have  to  be  buffered,  but 
as  shown  by  the  examples,  if  the  concentrator  gradually  feeds 
the  network,  the  network  buffering  may  not  need  to  be  too 
large.  The  idea  here  is  to  use  most  of  the  total  buffering 
in  the  system  near  the  sources.  This  concept  will  be 
explored  further  in  Chapter  4. 

A question  to  be  asked  now  is  whether  or  not  the  use  pf 
the  gradual  input  model  gives  widely  different  results  than 
the  M/M/1  model  for  networks  that  have  actually  been  imple- 
mented. Figure  3.13  shows  the  a 26  node  version  of  the  ARPA 
network.  A major  topological  feature  of  the  network  is  that 
it  contains  long  chains  of  nodes.  It  is  in  these  chains  that 
the  gradual  input  model  differs  most  from  the  M/M/1  model. 
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Figure  3.17  shows  a situation  in  which  the  two  models 
give  different  results.  The  gradual  input  queue  can  show 
the  effect  of  the  traffic  on  the  two  input  channels  to  node 
2 being  unequal  while  the  M/M/1  model  cannot.  Figure  3.18 
gives  a graph  of  Pr (overflow)  vs.  buffer  size  that  illustrates 
this  effect.  This  situation  is  one  in  which  the  independence 
asstimptiont  used  in  the  network  of  M/M/1  queues  model  can 
greatly  decrease  the  accuracy  of  the  model.  The  independence 
assumption  negates  the  effect  of  having  most  of  the  traffic  at 
a node  eurrive  over  one  channel. 

In  the  ARPA  network  chains,  one  can  also  observe  the 
buildup  of  busy  period  length  as  traffic  progresses  along 
the  chain.  Figure  3.17b  shows  one  such  chain  where  the 
utilization  of  output  channels  1,  2 and  3 is  the  same,  but 
the  expected  busy  period  length  is  different  for  each  stage. 
The  length  increases  as  one  progresses  along  the  chain. 

Figure  3.19  gives  the  Pr (overflow)  vs.  buffer  size  for  this 
situation . 

The  chains  in  the  ARPA  network  are  where  the  greatest 
differences  can  be  seen  using  the  gradual  input  model  because 
hare  the  buffers  have  few  inputs.  As  was  shown  in  Chapter  2, 
gradual  input  buffers  with  many  inputs  approach  the  behavior 
of  an  M/M/1  queue. 

^See  the  summary  of  previous  buffering  studies  in  Chapter  1. 
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a.  A two  node  chain  used  to  study  the 
effects  of  u^  U2> 


b.  A long  chain  showing  the  buildup  of 
busy  period  length. 


FIGURE  3.17  - Queueing  in  chains  of  gradual  input  queues 
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FIGURE  3.18  - Pr (overflow)  for  Figure  3.17a. 


127 


A final  effect  that  can  be  seen  using  the  gradual  input 
model  is  that  if  there  are  many  inputs  to  a network,  the 
traffic  tends  to  get  caught  up  at  the  input  nodes  and  only 
slowly  filter  through  the  internal  network  nodes.  Figure 
3.20  shows  a simple  situation  that  illustrates  this.  Eight 
sources  are  being  concentrated  onto  a single  output  ch^ulnel. 

If  this  is  done  in  one  stage,  this  stage  will  have  more 
queueing  than  the  se'^ond  stage  of  a two  stage  network. 

Figure  3.21  gives  the  expected  maximum  buffer  contents  that 
verify  this.  Again,  this  effect  cannot  be  seen  using  the 
M/M/1  model. 

3.3  The  Static  Routing  Problem 

The  determination  of  the  routing  policy  used  in  a 
message  switched  communication  network  is  an  important 
problem.  Much  work  has  been  done  in  the  area  of  static 
routing  policies  that  seek  to  minimize  mean  delay  through 
a network.  This  section  briefly  discusses  some  aspects  of 
such  a static  routing  policy  for  a network  of  gradual  input 
queues.  The  problem  is  a complex  one  and  the  optimal  solution 
of  it  is  beyond  the  scope  of  this  thesis. 

Throughout  this  chapter  the  gradual  input  model  has 
been  compared  to  a network  of  M/M/1  queues  as  used  by 
Kleinrock  [KLEIN  64] . This  will  again  be  done  here.  The 
optimization  problem  of  static  routing  (using  mean  delay/ 
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FIGURE  3.21  *•  Expected  maximum  buffer  content  in  a busy 
period  for  the  concentration  structures  in 
Figure  3.20 
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Bwssage  as  the  criterion)  has  been  solved  by  Cantor  and 
Gerla  [CANT  74] . They  have  shown  that  the  problem  can  be 
formulated  as  a miilticommodity  flow  problem.  Their  problem 
formulation  is: 

Given:  A network  of  N nodes  and  NA  directed 

channels  with  finite  capacities  and  an 
N X N matrix  K-  I whose  entries  are 
the  required  mean  flows  between  nodes 
1 and  j . 

Minimize:  The  mean  delay /message  through  the  network. 

Constraints:  1.  The  requirements  r^^  are  met. 

.2.  The  flow  through  each  channel  is  less 
than  or  equal  to  its  capacity. 

This  problem  is  solved  by  a mathematical  programming 
algorithm  which  finds  the  mean  flows  through  the  network 
that  produce  minimal  delay.  The  algorithm  relies  on  the 
fact:  that  the  region  of  feasible  flows  (flows  which  satisfy 
the  constraints)  is  a convex  polyhedron  and  that  the  objective 
function  is  a convex  function  of  the  flows.  From  the  optimal 
mean  flows,  a routing  policy  is  determined.  The  mean  flow 
solution  does  not  uniquely  specify  a routing  policy,  however 
all  policys  giving  the  same  mean  flow  have  the  same  mean 
delay  in  the  M/M/1  model.  This  correspondence  between  mean 
flows  and  mean  delay  is  central  in  the  Cantor  and  Gerla 
analysis.  This  relationship  does  not  hold  for  networks  of 

t 

gradual  input  queues  as  will  be  shown  below. 


132 


A minimum  mean  delay/bit  static  routing  problem  for  a 
network  of  gradual  input  queues  has  basically  the  seune 
statement  as  that  given  by  Cantor  and  Gerla.  The  only 
difference  in  the  statement  is  the  objective  function.  Since 
the  exact  expression  for  the  mean  delay/bit  for  a gradual 
input  queue  has  not  been  determined,  either  the  upper  or 
lower  bound  developed  in  Section  2.1.3  must  be  used.  Let 
E(d^]  be  the  chosen  ''ound  on  the  expected  delay  per  bit  for 
the  ith  channel,  u^^  be  the  throughput  through  that  channel 
and  u^  be  the  total  throughput  for  the  network.  Then  the 
objective  function  for  expected  delay/bit  would  be 

. NA 

E[dl  - ^ Z u,  E[dJ 
“t  i-1  ^ ^ 

As  an  illustration  of  the  routing  problem  for  gradual 

c 

input  queues,  consider  the  simple  network  shown  in  Figxire 
3.22.  In  this  example  there  are  two  inputs  with  traffic 
for  the  same  destination.  Since  there  are  no  other  inputs 
in  this  example,  it  is  easy  to  see  that  the  minimum  delay/ 
bit  routing  solution  is  to  send  all  the  traffic  from  one 
source  over  channels  1 and  2 and  send  all  of  the  traffic 
from  the  other  source  over  channel  3.  This  solution  produces 
no  waiting  lines  at  any  of  the  channel  buffers  and  therefore 
has  minimiim  delay.  Any  other  static  routing  policy  would 
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produce  a waiting  line  in  the  buffers  for  channels  1 and  3. 
Some  of  these  other  policies  would  produce  the  seune  mean 
flows  as  the  optimal  policy,  but  would  have  a different 
delay . 

Because  the  mean  delay/bit  is  not  specified  by  mean 
flows  alone,  the  routing  optimization  must  be  done  by 
considering  the  routing  matrix  Z directly.  The  question  to 
be  answered  now  is  whether  or  not  the  resulting  optimization 
problem  involves  a convex  objective  function  over  a convex 
region  so  that  mathematical  programming  techniques  can  be 
applied  to  find  the  optimal  solution. 

It  is  relatively  straightforward  to  answer  the  question 
about  the  feasible  region.  Let  and  Z^  be  any  two  routing 
matrices  that  are  feasible.  Then  Z^  * aZ^^  (l-a)Z2,  0-a-l, 
is  also  feasible.  This  is  because  Z^  sends  a fraction  a of 
all  traffic  according  to  policy  Z^  and  a fraction  (1-a) 
according  to 'policy  Z2«  Clearly  this  meets  both  the  flow 
req\iirements  between  node  pairs  and  the  capacity  constraint. 
Therefore,  since  Z^  is  feasible,  the  feasible  region  for  the 
overall  problem  is  convex.  ' 

Unfortunately,  the  objective 'function  E[d]  is  not  convex. 
The  example  in  Figure  3.22  points  this  out.  Clearly  in  this 
case  there  are  two  solutions  which  give  no  queueing  and 
therefore  are  optimal.  Since  the  objective  function  is  not 
convex,  applying  mathematical  programming  techniques  to  the 
problem  does  not  guarantee  that  the  solution  find  is  globally 
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optimum. y It  should  be  noted,  however,  that  the  two  solutions 
in  the  small  example  are  both  globally  optimum  and  in  some 
sense  equivalent.  If  the  objective  fiinction  is  such  that 
there  are  no  locally  optimum  points  that  are  not  globally 
optimum,  finding  one  of  them  using  mathematical  programming 
would  be  very  useful. 

Zt  should  also  be  noted  that  if  dynamic  routing  were 
used  in  this  example,  then  the  objective  function  would  be 
convex.  This  follows  from  the  fact  that  any  convex  combina- 
tion of  the  above  two  mean  flow  solutions  could  be  used 
tdiile  achieving  no  queueing  at  node  1.  Dynamic  strategies 
can  theoretically  give  superior  performance  in  many  network 
situations,  but  there  analysis  is  difficult  and  is  beyond 
the  scope  of  this  thesis.  Dynamic  routing  strategies  remain 
an  area  for  future  research. 
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CHAPTER  IV  - FLOW  CONTROL  IN  TREE  CONCENTRATION  STRUCTURES 

The  analysis  of  message  switched  coiranunication  networks 
presented  thus  far  has  not  considered  the  use  of  flow  control 
rules.  The  purpose  of  this  chapter  is  to  study  flow  control 
in  tree  concentration  structtores.  The  flow  control  studied 
is  used  to  prevent  buffer  overflow  in  the  interior  of  the 
tree  structure,  i.e.  any  overflows  will  be  at  the  nodes  to 
which  sources  are  directly  connected. 

The  flow  control  rules  that  can  be  used  in  a system 
depend  to  a certain  extent  on  the  buffers  available  in  the 
system.  Therefore  the  problem  of  buffer  allocation  is 
considered  in  the  first  section  of  this  chapter.  It  is  shown 
that,  in  certain  cases,  placing  all  buffers  at  source  nodes 
in  the  tree  allows  the  system  to  operate  with  the  smallest 
probedaility  of  buffer  overflow.  The  flow  control  policy 
that  minimizes  the  probability  of  buffer  overflow  for  these 
cases  is  then  discussed.  The  section  ends  with  the  presenta- 
tion of  an  example  which  shows  that  it  is  not  always  optimal 
to  place  all  buffers  at  the  source  nodes. 

The  second  section  of  this  chapter  deals  with  the 
approximate  analysis  of  a concentration  tree  in  which  flow 
control  is  being  used.  It  is  shown  that  '^e  tree  can  be 
analyzed  one  stage  at  a time,  the  coupling  of  the  dynamics 
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b«tw«cn  stagss  baing  approximately  represented.  The 
approximations  made  eure  supported  by  a theorem  for  first 
passage  times  in  Markov  Chains  and  by  simulation. 

Determining  the  Optimum  Buffer  Allocation  in  a Tree 

Concentration  Structure 

The  optimality  of  buffering  only  at  source  nodes 
The  problem  of  determining  the  buffer  allocation  in  a 
tree  concentration  structure  using  flow  control  that  minimizes 
the  probability  of  buffer  overflow  is  best  studied  by 
considering  specific  examples.  As  a first  example,  the  two 
level  tree  shown  in  Figure  4.1  will  be  studied.  The  tree 
structvire  considered  here  is  symmetric  so  that  the  stage  1 
nodes  are  both  assumed  to  have  a buffer  size  x and  stage  2 
is  assumed  to  have  a buffer  size  y.  The  output  channel  of 
•^9*  2 has  capacity  ■ 1 and  the  chMnels  between  the  two 
stages  are  assumed  to  have  capacities  less  than  or  equal  to 
C^.  This  restriction  on  the  channel  capacities  between  the 
stages  is  important  in  determining  the  optimal  buffer  alloca- 
tion in  the  tree  structure. 

The  tree  structure  in  Figure  4.1  is  to  be  operated 
using  a flow  control  policy  that  does  not  allow  traffic  to 
ba  lost  (due  to  buffer  overflow)  at  stage  2.  This  can 
obviously  be  done  by  restricting  the  flow  from  the  stage  1 
nodes  whenever  the  buffer  at  stage  2 is  full.  Therefore  all 
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stage  1 Stage  2 


buffer  size  x 


buffer  size  x 


FIGURE  4.1  Two  level  tree  example. 
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overflows  will  occxir  st  stage  1.  It  will  be  ass^lmed  that 
there  is  an  instantaneous  controller  that  observes  the  state 
of  the  entire  tree  emd  carries  out  the  flow  control  policy. 

For  the  class  of  all  such  flow  control  policies , the  problesi 
now  is  to  find  the  buffer  allocation  and  flow  control  that 
mlnlinizes  the  probability  of  buffer  overflow  for  the  system, 
subject  to  the  constraint  that  2x  + y - v,  i.e.  that  the  total 
buffer  size  is  - v.  In  the  discussion  that  follows  it  will 
be  shown  that  the  buffer  allocation  is  x > v/2;  y « 0 is  the 
desired  allocation.  This  allocation  can  be  determined  without 
first  specif ing  the  flow  control  policy  exactly. 

Before  proceeding  with  the  main  result,  it  is  necessary 
to  make  an  observation  about  the  service  discipline  at  stage 
2.  Note  that  as  long  as  the  service  discipline  at  stage  2 is 
work  conserving  (data  is  sent  over  the  output  channel 
whenever  possible)  the  choice  of  the  exact  service  discipline 
there  cannot  effect  the  probability  of  buffer  overflow  at  the 
input  stage  to  the  system.  Therefore,  for  convenience,  the 
service  discipline  at  stage  2 that  will  be  used  is  the  one 
which  always  keeps  the  number  of  bits  from  streams  A and  B 
(the  two  input  nodes)  that  are  at  stage  2 equal.  It  is 
possible  to  do  this  in  a work  conserving  manner  without 
effecting  the  stage  1 nodes.  To  see  that  this  is  true,  note 
that  the  contents  of  the  stage  2 buffer  increase  only  when 
traffic  from  both  streams  A and  B is  entering  the  buffer. 
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During  times  of  buffer  increase  it  is  therefore  possible  to 
keep  the  number  of  bits  from  streams  A and  B equal  at  stage 
2 independent  of  the  rule  used  to  determine  when  or  how  much 
traffic  is  sent  from  the  sotorce  nodes.  Clearly,  it  is  also 
possible  to  do  this  when  the  buffer  contents  of  stage  2 are 
remaining  constant  or  decreasing.  This  service  discipline 
at  stage  2 therefore  places  no  restrictions  on  the  operation 
of  the  stage  1 nodes  that  could  effect  the  probability  of 
buffer  overflow  there. 

nie  following  can  now  be  shown: 

Let  t ■ 0 be  the  start  of  a busy  period  for  a tree 
structure  as  shown  in  Figure  4.1.  Also  let  R, (t)  and  R_(t), 

A 8 

t - 0,  be  the  empty  buffer  available  at  nodes  A and  B 
respectively,  given  that  there  have  been  no  overflows  betv/een 
time  0 and  t.  Then,  using  a flow  control  rule  that  allows 
no  overflows  at  stage  2,  the  buffer  allocation  that  maximizes 
both  R^(t)  and  Rg(t)  for  all  t > 0 and  2x  + y - v is  x ■ v/2; 
y - 0, 

Hie  proof  of  this  will  be  done  by  comparing  the  two 
systems  shown  in  Figure  4.2.  System  1 is  the  proposed  optimal 
system  while  System  2 is  any  other  symmetric  system.  System 
2 will  be  assumed  to  be  operating  using  an  optimal  flow 
control  policy  for  its  particular  buffer  configuration. 

System  1 will  be  assumed  to  be  operating  in  a way  such  that 
the  total  buffer  contents  in  it  «re  the  same  as  in  System  2. 
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can  be  done  fyom  t ■ 0 until  the  first  buffer  overflow 
in  either  system?  which  is  the  time  period  of  interest  here, 
for  this  time  period  it  will  be  shown  that 

(t)  and  R^(t)  ^ R|(t)  t ^ 0 

where  the  superscripts  refer  to  System  1 and  System  2 
respectively, 

Att»0itis  assumed  that  both  systems  are  empty. 
Therefore  it  is  obvious  that 

fJ(0)  » rJ(0)  ^ v/2 

while 

But  since  2x  * y • V end  y > 0,  it  follows  that  x < v/2  and 
therefore 

»J{0)  > h|(0)  and  JiJ(O)  > R^(0) 


■^This  will  become  apparent  later  in  the  proof. 
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For  a time  t > 0,  let  a^Ct)  and  b^Ct)  be  the  number  of 
bits  from  traffic  streams  A and  B that  are  in  the  system. 
Similarly/  let  a2  (t)  and  b2(t}  be  the  number  of  bits  at  the 
second  stage  of  System  2.  From  the  use  of  the  service 
discipline  at  stage  2 that  keeps  the  number  of  bits  from 
streams  A and  B equal,  it  follows  that 

SjCt)  - b2(t)  - y/2 

Note  that  this  implies  that  a^(t)  and  b^(t)  for  System  2 are 
both  < v/2.  Therefore  System  1 can  be  operated  in  such  a way 
that,  before  the  first  overflow,  it  always  has  the  same  a^(t) 
and  b^(t)  as  System  2. 

In  order  to  compare  System  1 and  System  2 for  t > 0,  it 
is  necessary  to  determine  exactly  where  the  stored  traffic 
bits  are  located.  Assume  that  there  are  a^(t)  emd  b^(t)  bits 
in  both  systems.  Then  for  System  1 it  is  easy  to  see  that 
this  traffic  must  be  stored  as  shown  in  Figure  4.3.  From 
this  storage  configuration  it  follows  that 

Rj(t)  - v/2  - a,p(t)  t > 0 

Rj(t)  - v/2  - b^(t)  t > 0 
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For  Sy9ton  2 location  of  the  stored  bits  is  not 
known  exactly.  However,  it  can  be  shown  that  even  if  they 
are  in  the  heat  possible  locations.  System  2 will  not  perform 
better  than  System  1.  There  are  two  situations  that  need  to 
be  examined  for  System  2. 

The  firat  ?ase  to  be  considered  is  when  both  a^{t)  emd 
b^(t)  are  * y/2.  Then  the  best  possible  eurrangement  of  bits 
in  System  2 is  as  shown  in  Figure  4.4a.  For  this  case  then 

4(t) . X (a,(h)  - y/2) 

» J¥  * y/2  » SyCt) 

• y/J  » s^(t)  when  2x  + y ■ V 


Similarly 

t'* 

Rj(t)  » v/2  - by(t) 

Therefore  in  this  ease  System  1 and  System  2 have  the  seune 
Rj^(t)  and  Rj(t) » 

The  second  case  tP  be  considered  is  when  either  1) 
m^(t)  < y/2  end  a^(t)  < bij(t);  or  2)  b^(t)  < y/2  and  b^(t)  < 
e^Ct).  Since  the  system  is  symetric,  these  two  conditions 
ere  equivalent.  The  best  possible  arrzmgement  of  bits  in 


'2 

:)-y/2] 


Stage  2 


)-y/2 


a2(t)-y/2 


gyst^  2 for  the  first  of  these  conditions  is  shovm  in 
Figure  4.4b,  As  shown,  the  fact  that  aj  (t)  - bj  (t)  < y/2 
CSUiee  some  unused  buffer  space  at  stage  2.  The  result  is 
tb4t 

* x**<«y(t)-a2(t})<x-(a^(t)-y/2)  « R^Ct) 

«nd 

Rj(t)  • x-(by(t)-b2(t))<x-(b^(t)-y/2)  - R^Ct) 

The  analysis  of  the  case  b^(t)  < y/2  and  b^(t)  < a^{t)  is 
■inilar.  Therefore 

Rj(t)  - Rj(t)  and  Rj(t)  - R^(t)  t - 0 

Q.E.D. 

What  has  been  shown  is  that  from  the  start  of  a busy 
until  the  first  overflow  in  the  system,  it  is  better 
to  have  all  buffers  at  source  nodes.  Maximizing  Rj^(t)  and 
Rg(t)  over  this  time  period  corresponds  to  minimizing  the 
probability  of  at  least  one  buffer  overflow  in  a busy  period 
considered  in  the  previous  chapters.  The  proof  does  not 
extend  past  the  first  overflow  because  after  that,  it  is 
not  possible  to  assume  that  the  number  of  bits  stored  in 
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Systems  1 and  2 Is  the  same.  However*  if  the  traffic  arrival 
process  at  soxirce  nodes  has  a uniform  arrival  rate  for  all 
time*  there  is  reason  to  believe  that  System  1 has  a lower 
overall  probability  of  buffer  overflow  and  hence  a higher 
throughput.  This  will  be  apparent  in  the  example  in 
Section  4.1.3. 

The  above  example  is  a special  case  in  that  it  is 
symetriC/  has  only  two  source  nodes  and  has  an  interstage 
communication  capacity  - C^,  the  tree  output  capacity.  It 
is  now  logical  to  ask  if  the  result  can  be  extended  to  other 
concentration  trees. 

The  last  restriction,  the  restriction  on  interstage 
channel  capacity,  is  central  to  the  proof  just  given.  If 
this  is  not  true,  the  service  discipline  at  stage  2 that 
keeps  SjCt)  and  bj (t)  equal  effects  the  probability  of  over- 
flow at  stage  1.  To  see  this  consider  the  arrival  of  a 
message  into  an  empty  system.  If  the  internal  capacity  C > 
a queue  of  only  one  type  of  message  (A  or  B)  will  build  up 
at  stage  2 luiless  the  flow  rate  out  of  stage  1 is  restricted 

to  C-.  Such  a restriction  at  the  source  node  would  effect 
o 

the  probability  of  overflow  there.  Note  that  when  the  inter- 
stage capacity  is  > the  buffer  at  stage  2 can  be 

effectively  used  when  traffic  of  only  one  type  is  in  the 

$ 

system.  This  is  not  true  otherwise  and  therefore  one  would 
expect  that  as  the  interstage  capacity  becomes  large  with 
respect  to  C^,  it  becomes  optimal  to  place  some  buffers  at  stage  2 
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If  the  condition  of  symmetry  is  removed  from  the  problem, 


the  result  that  it  is  best  to  place  all  buffers  at  source 
nodes  will  still  hold.  This  can  be  seen  by  comparing  two 
systems  as  shown  in  Figure  4.5.  It  can  be  shown  that  System 
1 is  better  than  System  2 by  using  the  same  technique  that 
was  used  for  the  symmetric  case.  Therefore,  no  matter  what 
the  optimal  allocation  and  Xg  with  y > 0,  the  allocation 
+ y/2  and  Xg  + y/2  at  the  source  nodes  will  be  better. 

The  same  technique  of  proof  cannot  be  extended  to  trees 
with  more  than  two  input  nodes.  The  reason  for  this  is 
illustrated  in  Figure  4.6.  With  more  than  two  input  nodes, 
the  traffic  from  any  node  is  still  restricted  to  occupying 
leas  than  half  of  the  stage  2 buffer  because  of  the  service 
discipline  assumed  there.  However,  for  certain  buffer 
contents,  this  allows  for  an  arrangement  of  bits  at  stage  2 
such  that  two  inputs  effectively  use  the  buffer  there  and  there 
by  relieve  congestion  at  source  nodes.  For  the  case 
illustrated  in  Figure  4.6  the  result  of  this  is  that 

but  rJ  < sj  rJ  < rJ 

Therefore  it  cannot  be  argued  that  System  1 has  a lower 
Pr (overflow) . 

ISO 
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FIGURE  4.5  ■*  Unsymmetric  concentration  trees 


«.  System  1 

v/3-2 


b.  System  2 


FIGURE  4.6  - A three  source  node  tree 


This  does  not  disprove  the  optimality  of  placing  all 
buffers  at  source  nodes  for  this  example.  It  only  shows  that 
this  method  of  proof  cannot  be  used  to  obtain  the  result. 

In  Section  4.1.3  a 3 source  node  discrete  time  example  is 
given  for  which  it  is  optimal  to  place  all  buffers  at  source 
nodes. 

There  are  situations  in  which  the  buffer  allocation 
that  minimizes  the  probability  of  buffer  overflow  for  trees 
with  more  than  2 source  nodes  can  be  obtained  directly.  One 
is  the  case  where  the  arrivals  at  source  nodes  occur  according 
to  a Poisson  process  with  rate  X-»-0  and  instantaneous  (not 
gradual)  input.  Since  \-^0,  there  is  rarely  any  congestion 
anywhere  in  the  tree.  Therefore,  independent  of  the  number 
of  buffers  at  stage  2,  the  following  occurs. 

Pr  (Buffer  overflow)  Pr(New  message  fits  in  source 

node {system  is  empty) 

Clearly,  this  probability  is  minimized  by  placing  all  buffers 
at  source  nodes. 

The  above  case  (A**>0)  depends  greatly  on  the  fact  that 
the  arrivals  occur  instantaneously.  In  Section  4.1.3  it 
will  be  shown  that  if  the  arrivals  are  more  gradual  in  nature, 
it  is  possible  to  have  a situation  in  which  some  buffering 
at  stage  2 is  optimal.  Therefore  it  is  not  always  optimal 


to  place  all  buffers  at  source  nodes.  This  section  has 
shown  ^ough  that  it  is  sometimes  optimal  and  therefore 
it  if  worthwhile  exaunining  the  flow  control  problem  when 
all  buffers  are  at  source  nodes. 

0 

Fl^v^ontrol  when  all  buffers  are  at  source  nodes 

^e  previous  section  showed  that  in  certain  cases  it 

ppti^l  to  place  all  buffers  at  soxirce  nodes  in  a concen- 

^i^ion  tree.  %e  method  used  to  obtain  this  result  did  not 

fPffily  the  specific  flow  rule  that  should  be  used  with  this 

allocation.  Consider  again  the  system  in  Figure  4.1. 

if  ia  no  buffer  at  stage  2,  then  clearly  the  output 

fftes  of  nodes  A and  B must  be  controlled  so  that  their 

t9%al  output  rate  is  * C^,  Since  the  objective  is  to  minimize 

•Vff flows,  the  flow  rule  should  consider  the  current  buffer 

ffpntfnta  of  the  source  nodes  and  give  priority  to  the  node 

PVft  likely  to  overflow  next.  If  one  assumes  that  the  input 

rttfs  are  known  or  have  been  estimated,  then  the  probability 

0#  9verflpw  in  the  next  At  time  unit  can  be  calculated  for 

••eh  node,  The  node  with  the  largest  overflow  probability 

••It  thfn  he  allowed  to  send  at  rate  C..  This  node  retains 

o 

tht  Bllpcation  until  there  is  another  node  with  a higher 
probability  of  overflow  in  the  next  At.  If  one  uses  Poisson 
input  ^del  with  input  rate  X,  this  probability  of  overflow 
in  the  next  At,  0 < At  <<  1,  is 


Pr (overflow  next  At)  » Pr  (message  arrives  in  At  and 

has  length  h>  remaining 
buffer  size) 

- Xlt  ’ 

h»x„-x(t) 

ni 

%rtiere  x.  is  the  buffer  size^  x(t)  is  the  current  buffer 
content  and  u ^ is  the  mean  message  length  (assume 
exponentially  distributed) . For  small  At,  lAt  is  the  pro- 
bability  of  an  arrival  in  a Poisson  process  [DRAKE  67] . 

The  flow  r\ile  described  above  is  a myopic  control  policy. 
This  means  that  it  seeks  to  optimize  over  the  immediate  future. 
The  question  now  is  whether  this  type  of  rule  produces  the 
minimum  overall  probability  of  overflow.  This  problem  is 
being  studied  by  Yee  [YEE  76]  using  discrete  time,  discrete 
state  space  models  euid  Markoviem  Decision  Theory  [HOWD  71] . 

He  has  found  for  some  examples  that  myopic  policies  are 
indeed  optimal  for  maximizing  the  expected  time  between 
overflows.  This  is  the  same  as  minimizing  the  probability 
of  overflow.  Yee's  results  are  for  specific  examples  and 
therefore  an  open  question  is  whether  his  results  can  be 
generalized.  If  so,  flow  control  for  concentration  trees 
with  all  buffers  at  source  nodes  would  be  greatly  simplified. 

The  flow  control  rule  used  here  assumes  that  there  is  a 
global  controller  with  knowledge  of  the  state  of  all  nodes. 

In  an  actual  network,  this  controller  would  logically  be 
located  at  stage  2 so  that  it  could  easily  collect  the 
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state  information  from  the  source  nodes  and  send  the  flow 


allocations  back  to  them.  The  transmission  of  control 
information  that  is  required  for  this  has  not  been  included 
in  the  model  presented  here.  If  control  information  is  sent 
frequently,  it  may  become  a significant  part  of  the  total  ' 
traffic  and  would  be  important  to  include.  There  is,  however, 
a scheme  of  transmitting  state  information  to  stage  2 that 
does  not  introduce  extra  overhead.  The  idea,  due  to 
Wozencraftt  is  to  use  a round  robin  service  discipline  at  each 
of  the  source  nodes.  The  round  robin  discipline  sends  a 
fixed  length  part  of  each  message  at  the  node  each  time  the 
node  is  allowed  to  send  to  stage  2.  The  stage  2 node  can 
then  determine  the  queue  size  at  the  source  node  by  counting 
the  nxsnber  of  blocks  of  data  in  one  round  robin  scan  of  a 
source  node.  In  this  way  the  source  state  information  is 
not  sent  as  an  extra  message. 

One  final  point  about  controlling  a tree  with  all  source 
buffers  is  that  if  the  control  is  not  instantaneous,  some 
buffering  may  need  to  be  at  stage  2 to  account  for  the  delay 
in  turning  various  source  nodes  on  and  off. 


T 
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4.1.3  The  effect  of  aradual  inouts 


The  optimality  of  placing  all  buffers  at  source  nodes 
was  shown  in  Section  4.1.1  for  a certain  case  with  Poisson 
traffic  sources.  If  the  traffic  sources  are  not  Poisson/ 
but  rather  more  gradual  in  nattrce/  this  result  may  no  longer 
hold.  The  following  discrete  time  example  illustrates  this 
point.  The  discrete  time  example  is  used  because  it  can  be 
easily  analyzed  and  yet  provides  the  relevant  insight  into 
the  problem. 

Figure  4.7  shows  two  concentration  trees  that  will  be 
cotnpeured.  Each  contains  four  fixed  length  buffers  and  the 
question  to  be  answered  is  which  gives  the  lower  probability 
of  overflow  when  operated  with  a flow  control  rule  that  does 
not  allow  overflows  at  stage  2.  The  systems  operate  in 
discrete  time.  The  basic  time  unit  is  the  interval  T 
illustrated  in  Figure  4.8.  At  the  beginning  of  an  interval, 
messages  arrive  at  the  source  nodes.  During  the  interval 
exactly  one  message  can  be  sent  over  each  communication 
channel  in  the  tree.  This  means  that  at  most  one  message 
can  be  sent  over  the  tree  output  channel  during  an  interval  T. 

TWO  different  arrival  processes  will  be  studied  for 
these  systems.  In  Process  1,  for  each  time  interval  T,  the 
number  of  messages  that  arrive  at  each  source  node  is  a 
Poisson  random  variable  with  parameter  X . This  means  that 
for  each  source  node 
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ft  System  1 


Stage  2 


ftfge  I 

3 Identical 


C 

bt  System  2 


C 


FZGURZ  4.7  * Two  concentration  trees  to  be  compared 


figure  4.8  - Time  intervals  in  the  discrete  time  system 
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1 

PrOn  messages  arrive)  ■ ml~ m-0,1,2,3, . . . 

In  arrival  Process  2 only  0,1  or  2 messages  can  aurrive  in 
each  interval  T at  each  of  the  nodes.  The  probabilities 
associated  with  these  arrivals  at  each  node  will  be  denoted 
by 

2 

Pr(ffl  messages  arrive)  « cQ  m>0,l,2 

The  arrivals  in  each  interval  are  independent  so  that 
the  entire  system  can  be  modeled  as  a Markov  chain.  The 
states  of  the  chain  eure  specified  by  the  number  of  messages 
at  each  node.  The  states  for  the  two  systems  are  listed  in 
Tables  4.1  emd  4.2.  As  shown  in  the  tables,  one  must  be 
specific  about  exactly  when  in  time  a state  is  referred  to. 

TWO  times  2u:e  used  in  the  analysis  here.  The  first,  indexed 
by  the  interval  number  n”  , is  just  prior  to  the  arrival  of 
the  new  messages  in  the  nth  interval.  The  second,  Indjsxed 
by  , is  just  after  the  arrival  of  the  new  messages.  Let 
x(n}  be  the  state  number  at  time  n (n*l,2,3...) (either  n^ 
or  n ) and  let  ir^(n)  ■ Pr(x(n)«i)  be  the  state  occupancy 
probability  of  state  number  i.  Then  the  problem  to  be  solved 
is  the  determination  of  the  vector  of  steady  state  occupancy 
probabilities 

1*  • lim  !r(n)'*' 
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In  order  to  solve  for  the  vector  IT^ , the  matrix  of  one 
itep  transition  probabilities,  P‘,  must  be  determined.  The 
flements  of  P are  p^^  ■ Pr(x(n+1)^  » j|x(n)'*’  ■ i) . This 
IMtrix  can  be  determined  by  examining  the  state  transitions 
due  to  message  arrivals  and  those  due  to  message  departures 
foparately.  From  time  n^  to  (n-fl)  , the  only  state  transi- 
tions that  can  occur  are  those  due  to  message  departures. 

Which  transition  occurs  depends  only  on  the  starting  state 
•t  time  n^  and  the  flow  rule  used.  The  flow  rule  can  be 
deterministic  when  conditioned  on  the  starting  state.  For 
the  simple  example  here,  it  is  easy  to  choose  the  flow  rule 
that  minimizes  the  probability  of  buffer  overflow.  The  flow 
rule  transitions  are  given  in  Tables  4.1  and  4.2.  These 
deterministic  transitions  can  be  represented  by  a transition 
matrix  whose  elements  are  p^^  » Pr  (x(n+l)“»j  |x(n)‘’’«i) . The 
following  thpn  holds. 

> 

Ifto+D*  » Jin)* 

Jlow  consider  transitions  from  time  (n+1)"  to  (n+l)'*’. 

These  transitions  result  only  from  message  arrivals.  Let 

^ he  the  transition  matrix  with  elements  p^^  » Pr(x(n)''’  ■ 

j|r(n}*  * i) • The  elements  p^^  can  be  expressed  in  terms  of 
% 

for  the  two  systems  and  the  two  arrival  processes 
considered  here.  Tables  4.3  2md  4.4  give  the  expressions 
for  these  elements  pj^.  The  following  now  holds. 
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TABLE  4.1 


State  Definitions  and  Flow  Rules  for  System  1 


State 
Number  i 


Description 

(Number  of  Messages  at  Nodes) 


State  Number 
at 

(n+l)".i^ 

x(n)  -i 


TABLE  4.2 


State  Definitions  and  Flow  Rules  for  System  2 


State 
Number  i 


1 

2 

3 

4 

5 

6 
7 


Description  State  Number . at 

(Number  of  messages  at  nodes)  (n+l)  “ if  x (n) ’’»i 

0 


A 

0 

0 

0 

0 

0 

0 

0 


B 

0 

0 

0 

0 

1 

1 

1 


c 

0 

0 

1 

1 

0 

0 

1 


0 

1 

0 

1 

0 

I 

0 


1 

I 

1 

2 

1 

2 
2 
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TABLE  4.3 


^tata  Transitions  Due  to  Arrivals  for  System  1 


Process  1 


9 


^0 


f • %l 

F2  * 1 - Q 


P 


Process  2 
Q - q 


P - q 


P2  « 


PB(l,l)  - Q*Q*Q 
PB(1,2)  - Q*Q*(1.0-Q) 

PB(1,3)  « Q*Q*(1.0-Q) 

PB(X,4)  - Q*(1.0-Q)*(1.0-Q) 

PB(l/5)  - Q*Q*P 
PB(1,6)  « Q*P*(1.0-Q) 

PB(1,7)  » Q*P*(1.0-Q) 

PB(l/8)  - P*(1.0-Q)*(1.0-Q) 

PB(1,9)  « P2*Q*Q 
PB(1,10)  « P2*Q*(1.0-Q) 

PB(1,11)  - P2*C*(1.0-Q) 

PB(1,12)  - P2*(1.0-Q)*(1.0-Q) 
PB(2,2)  - Q*Q 
PB(2,4)  - Q*(1.0-Q) 

PB(2,6}  - P*Q 
PB(2,8)  - P*(1.0-Q) 

PB(2/10)  - P2*Q 
PB(2,12)  - P2*(1.0-Q) 

PB(5,5)  - Q*Q*Q 
PB(5/6)  - Q*Q*(1.0-Q) 

PB{5,7)  - C*Q*{1. 0-Q) 

PB(5,8)  - Q'*(1.0-Q)*(1.0-Q) 

PB(5,9)  - (1.0-Q)*Q*Q 
PB(5/10)  - (1.0-Q)*Q*(1.0-Q) 
PB(5,X1)  - (1.0-<3)*Q*(1.0-Q) 
PB(5#X2)  - (1.0-Q)*(1.0-Q)*(1.0-Q) 
PB($,6)  - Q*Q 
PB(«/8)  - Q*(1.0-Q) 

PB(6,10)  - (1.0-Q)*Q 
PB(6,12)  - (1.0-Q)*(1.0-Q) 

PB(8,8)  - Q 
PB(8,12)  - 1.0-<3 
PB(9,9)  - Q*Q 
PB(9»X0)  - Q*(1.0-Q) 

PB(9,X1)  - Q*(1.0-Q) 

PB(9/12)  - (1.0-Q)*(1.0-Q) 


X64 


H*  M O M 


Process  1 

11  - 


9 * 3 -J 

? 9 i - 9 


TABLE  4.4 

gtate^Transitions  due  to  Arrivals  for  System  2 

Process  2 


i/j 


Q 

P 


1 - Q 


- Q*Q*Q 
Ft  (If  3)  » Q*Q*P 
FB(if5)  - Q*Q*p 
FB(lf7)  » Q*P*P 
FB(lf9)  « Q*Q*P 
FB(1,11)  - Q*P*P 
FB(ifl3)  - Q*P*P 
FB(1,15)  » P*P*P 
Pg(2,2)  - Q*Q*Q 

fB(2,4)  - Q*Q*P 
PB(2,6)  » Q*Q*P 
FB(2,8)  » Q*P*P 
FB(2,10)  » Q*Q*P 
FB(2,12)  » Q*P*P 
FB(2,14)  « Q*P*P 
FB(2,16)  - P*P*P 
FB(4,4)  - Q*Q 
FB(4,8)  - Q*P 
FB(4fl2)  - Q*P 
Ffl(4,16)  - P*P 
. FB(6/6)  - Q*Q 
FB(6,8)  - Q*P 
F?(6,14)  - Q*P 
FB(6,16)  - P*P 
FB(8,8)  « Q 
FB(.8fl6)  - P 
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ir(n+l)"^  • TTCn+l)”  F" 

- ir(n)*  r-  T- 

- ncn)*^  F 

TtM  desired  transition  matrix  is  then  the  product  of  F^  and  F*. 
The  well  known  result  that  if  the  chain  is  ergodic 

lim  TTCn)"^  « - F+  F IPRAZ  62] 

n**« 

can  then  be  applied  to  find  the  desired  steady  state  occupancy 
probedsilities . Once  IT^  is  known,  it  is  easy  to  determine 
trtiich  system  has  the  lower  probability  of  buffer  overflow, 
note  that  for  both  systems,  it^  is  the  probability  that  the 
system  is  empty  just  after  the  time  for  new  arrivals.  In 
ell  other  states  there  is  a throughput  of  one  message  in  the 
interval  T.  Therefore  the  expected  throughput  per  interval 
T is  1 - TT^.  Since  the  same  traffic  is  being  applied  to  both 
systems,  it  follows  directly  that  the  system  with  the  higher 
throughput  has  the  lower  probability  of  buffer  overflow. 

Tables  4.5,  4.6  and  4.7  give  the  system  throughputs  for 
different  input  processes.  Table  4.5  gives  the  results  for 
Process  1,  the  Poisson  input.  The  results  show  that  it  is 
best  to  place  all  buffers  at  source  nodes  for  all  values 


of  the  traffic  arrival  rate  X.  Table  4.6  gives  the  results 
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2 2 

for  Process  2 when  only  and  are  nonzero.  This  means 
|h§t  at  most  one  message  can  arrive  at  each  source  node 
during  an  interval  T.  This  is  a very  gradual  input.  In 
yiis  case,  placing  all  buffers  at  source  nodes  is  not  optimal 
fQX  uy  arrival  rate.  What  has  happened  is  that  enough 
^yrftiness  has  been  removed  from  the  arrival  process  so  that 
i§  mere  ^portant  to  place  some  buffering  at  stage  2 where 
if  is  more  useful  in  preventing  overflows  due  to  multiple 
§f rivals  in  qne  interval  T. 

|t  is  possible  to  explore  how  much  burstiness  is  needed 

i}»  the  traffic  to  roAke  it  optimal  to  place  all  buffers  at 

fouree  nodes  by  using  the  Process  2 model.  The  results  in 

indication  that  not  very  much  burstiness 

4f  needed.  The  ease  axamined  there  has  q*  « 0.2  while  q^  is 

2 

Vifled  over  a wide  range.  As  q*#  the  probability  of  2 

fffiyals,  is  increased,  the  burstiness  of  the  input  traffic 

2 

increases.  For  q^  very  small  (0  and  0.001)  it  is  not 

fft^mal  to  place  all  buffers  at  source  nodes.  However, 

2 

If^a  q^  becomes  larger  (0,01,  0.05  and  0.1)  it  is  optimal. 

Ill  f inclusion,  it  is  not  always  optimal  to  use  all  source 

kttlltrlng. 
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TABLE  4.S 


Exp«cted  Throughput  Using  Input  Process  1 

T ■ 1.0 


X 


System  1 


System  2 


.01 

.1 

.5 


1.0 


2.0 


.029899 

.288896 

.9549905 

.999728889 

l-(. 343404  X lO""^) 


.029850 

.285283 

.9524518 

.999719148 

l-(. 345133  X 10"*^) 
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TABLE  4.6 


Expected  Throughout  Using  Inout  Process  2 with  gj 

T^l.O 


System  1 

System  2 

0.1 

.298816 

.29974 

0.2 

.586201 

.59136 

0.3 

.824173 

.830993 

0.4 

.9545326 

.9572018 

0.5 

.9929578 

.993333 
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Mle  4.7 


Expected  Throughput  (Jsing 

Input  Process  2 

?! 

SyetM  1 

System  2 

9tQee 

*5862 

.591361 

§t§Qi 

,§89626 

.594133 

dtOio 

*919021 

.618851 

9«e5e 

.?38?58 

.722383 

9*100 

*990615 

.830993 

4.2.1  An  approximate  analvsis  of  a two  level  tree 

The  queueing  analysis  of  buffer  stages  coupled  by 
flow  consol  rules  is  a difficult  problem  if  the  system  is 
laet  operating  in  discrete  time  with  fixed  length  messages  as 
4n  Section  4.1.3,  It  is  often  possible  to  specify  reasonable 
flew  rules,  but  usually  not  possible  to  analytically  determine 
Die  performance  of  the  network  when  the  rules  are  used.  This 
feetipn  develops  an  approximate  analysis  for  a simple  example 
shows  some  techniques  for  overcoming  this  problem. 

The  tree  to  be  analyzed  is  shown  in  Figure  4.9.  The 
Input  nodes  A and  B in  this  example  are  receiving  Poisson 
Input  streams  of  messages  with  exponentially  distributed 
passage  lengths.  These  traffic  streams  are  then  fed. into 
gtage  2 over  finite  capacity  channels.  The  capacity  of 

channels  is  equal  to  the  capacity  of  the  output  channel 
of  ftage  2 when  no  flow  control  is  in  effect.  When  buffer  C 
fills  and  both  nodes  A ^md  B are  in  busy  periods,  the  rate  of 
•ach  of  the  channels  between  the  first  level  of  the  tree  and 
ftage  2 if  reduced  to  one  half  the  normal  rate.  This  keeps 
buffer  C from  overflowing.  If  buffer  C is  full  and  only  one 
stage  at  the  first  level  has  traffic,  the  rate  on  the  channel 
between  that  node  and  buffer  C is  kept  at  the  normal  rate. 

This  flow  rule  if  essentially  what  happens  if  link  by  link 
flow  control  is  being  achieved  by  rejecting  messages  at 
stage  2 whenever  the  buffer  there  is  full. 
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0 


Stage  1 


7X6UKE  4.9  - Two  level  tree  flow  control  problem.  The 

btiffers  at  each  level  are  finite.  All  channels 
^ve  the  same  capacity  in  the  absence  of 
flow  control. 


- 
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Even  for  this  simple  symmetric  example,  it  has  not  been 
feasible  to  solve  for  the  exact  steady  state  statistics  of 
bi^fer  occupancy  and  buffer  overflow.  Therefore  the 
following  approximate  analysis  will  be  used.  When  buffer  is 
not  full*  nodes  A and  B are  essentially  M/M/l/X  queues  if 
one  assumes  that  the  buffers  at  these  stages  can  hold  X 
messages.  As  long  as  buffer  C stays  below  its  maximum 
allowed  level,  the  traffic  streams  into  buffer  C are 
alternating  renewal  processes  as  required  for  that  stage  to 
be  analyzed  as  a gradual  input  queue  (see  Figure  4.10). 
Therefore  it  is  possible  to  use  the  results  for  probability 
of  buffer  overflow  developed  in  Chapter  2 to  partially 
characterize  the  behavior  of  stage  2.  Both  the  probability 
of  at  least  one  buffer  overflow  in  a busy  period  and  the 
probability  of  another  overflow  in  a busy  period,  given  that 
at  least  one *has  already  occurred  will  be  bounded  for  stage  2. 

Now  the  behavior  of  node  A will  be  represented  by  an 
approximating  continuous  time  Markov  chain.  Since  nodes  A 
and  B are  identical,  this  will  also  characterize  node  B. 

The  approximating  Markov  chain  is. shown  in  Figure  4.11.  The 
chain  is  best  understood  by  considering  a typical  sequence 
of  buffer  operation.  Suppose  that  buffer  A is  empty  and  that 
buffers  B and  C are  in  some  unknown  state,  but  buffer  C is 
not  full.  In  this  condition,  the  approximating  chain  is  in 
state  {1,0}.  As  a busy  period  starts  for  buffer  A,  the 
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Buffer  content  of  stage  2 


Zn  these  sections,  the  inputs  to  stage  2 are 
alternating  renewal  processes  with  exponential 
off  tiities  and  on  times  distributed  as  the  busy 
periods  of  an  M/M/l/X  queue 


PI6URZ  4.10  - Queueing  process  at  stage  2 


4 


[ 

I 


state  changes  along  row  I.  At  this  time/  buffer  C is  not 
full^  so  no  flow  control  restrictions  are  in  effect.  If 
bi^fer  C fills  dicing  this  busy  period,  the  state  will  change 
to  row  ZI  of  the  approximating  chain.  In  order  for  buffer  C 
to  have  filled  up.  buffer  B must  be  in  a busy  period  and 
toerefore  toe  flow  cpntool  that  reduces  the  rate  of  flow 

puffers  A ^d  B to  C to  half  the  normal  rate  goes  into 
fifect, 

As  19^9  SS  hpto  buffers  A and  B are  in  busy  periods, 
lAf  Stato  of  toe  system  will  remain  in  row  IZ.  If  buffer 
A f9SS  9lf  before  buffer  B,  the  state  can  change  back  to 
{1,0} , ' If  buffer  B goes  off  before  buffer  A,  the  state  will 
cAAAfe  to  row  III.  In  tow  III,  the  channel  -between  buffer 
A ftnd  buffer  C is  kept  at  the  normal  rate,  so  that  as  long 
§f  puffer  A is  in  a busy  period,  buffer  C remains  full, 
ffea  sew  III,  trauisitions  can  occur  back  to  row  II  or  from 
ftate  {111,0}  toey  can  occur  back  to  state  {1,0}. 

@4VSA  overall  description,  the  remaining  problem 

4f  fetepiining  toe  appropriate  transition  rabes.  Briefly, 
^eye  are  as  follows.  Along  row  I toe  rates  are  the  rate 
|gr  the  Poisson  arrival  process , and  U , toe  rate  of  service 
fenple^ons  for  exponentially  distributed  length  messages. 

Thf  rate  of  toansition  from  row  I to  row  li,  is  chosen 


f9  ^tt  toe  upper  bound  on  the  probability  of  at  least  one 


overflow  in  a busy  period  calculated  for  state  2 is  met.  The 
specifics  of  this  calculation  and  others  are  given  later  in 
this  section. 

Zn  row  II  (excluding  state  {11,0}}  both  buffers  A and  B 
are  in  busy  periods.  The  state  of  buffer  A is  accounted  for 
explicitly,  while  that  of  buffer  B is  not  precisely  }cnown. 
Knowing  that  buffer  B is  in  a busy  period  is,  however, 
sufficient  to  make  use  of  a result  on  the  tail  behavior  of 
the  busy  period  distribution  of  a queue  such  as  buffer  B is 
exponential  with  a well  defined  mean.  In  this  case  the  queue 
of  interest  is  an  M/M/l/X  queue  with  arrival  rate  \ and  mean 
service  time  2/u.  Let  5”^  be  the  mean  of  the  exponential 
tail  of  the  busy  period  distribution  of  such  a queue.  Then 
C will  be  the  transition  rate  used  for  transitions  caused  by 
the  busy  period  of  buffer  B ending.  For  a transition  from 
state  {11,0}  due  to  the  ending  of  a buffer  B busy  period, 
the  transition  rate  is  the  parameter  associated  with  the 
busy  period  tail  for  an  M/M/l/X  queue  with  arrival  rate  X 
and  mean  service  time  u~^. 

From  row  III,  transitions  occur  back  to  row  II  if  buffer 
B starts  a new  busy  period.  If  the  system  reaches  state 
{111,0} , a transition  can  be  made  to  state  {1,0}.  A transition 
to  state  {1,0}  is  taken  to  approximately  represent  the  end 
of  a busy  period  of  stage  2 without  another  overflow. 

Therefore  the- quantity  n/(n**’X)  will  be  equated  with  a lower 
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^un4  on  the  probability  of  not  having  another  overflow  in  a 
period  of  buffer  C,  given  that  there  has  already  been 
9t  least  one  in  this  busy  period.  The  specification  of  the 
rate  n completes  the  approximating  Markov  chain. 

«L 

Specific  details  are  now  given  for  calculating  the 
various  rates  in  the  approximating  chain.  The  case  in  which 
each  stage  1 node  has  2 buffers  (X*2)  is  used  as  an  illustra> 
tion»  After  the  transition  rates  are  determined,  the  chain 
is  analyzed  for  its  steady  state  occupancy  probabilities. 

The  probability  of  being  in  states  with  all  node  A buffers 
full  is  the  probability  of  overflow  measure  that  is  of 
interest  here. 

A*  'Determining  the  transition  rate  6 
The  transition  rate  ^ is  chosen  so  that  in  the 
approximating  chain 


fr  (9o  to  row  ii  start  in 

before  going  state  (1,1) 
to  (I/O)) 


- Pr (Overflow  at  least 
once  in  stage  2 
busy  period) 


1 

1 


This  is  done  because,  as  illustrated  in  Figure  4.10,  starting 
flow  control  (going  to  row  il)  corresponds  to  the  stage  2 
buffer  becoming  full.  Determining  the  rate  requires  three 
basic  steps. 

1*  Peternine  the  mean  length  of  the  stage  1 M/M/l/x 
queue  busy  periods.  This  can  be  done  using  a first  passage 
time  analysis  for  Markov  chains  as  in  Section  2.1.2. 
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Tor  case  X»2,  mean  busy  period  length  is  given  by 

6 • * X/y] 

2.  Deteraine  the  upper  bound  on  Pr (overflow)  for  stage 
2 when  ^e  two  inputs  have  mean  on  time  8 and  mean  off 

t^e  X"^.  This  can  be  done  by  using  Equation  2.18.  Denote 
^is  bound  by  fr  (overflow) . 

3.  Determine  so  that 

Pr  (6o  to  row  II  Start  in  « Pr (overflow) 

before  going  state  (1,1) 
to  (1,0) 

|n  order  to  dp  ^is,  one  must  solve  a trapping  problem  as 
illustrated  in  Figure  4.12  for  the  case  X»2.  As  shown  in 
^e  Markovian  ^ansition  rate  diagreun  given  in  the  figure. 

Pr  (6p  to  row  ii  Start  in  ■ Pr  (Trap  in  Start  in 

before  going  state  (1,1)  row  II)  state 

to  (1,0)  (1,1) 

This  gapping  probability  can  be  determined  by  system 
inaiysis  techniques  given  by  Howard  (HOWD  71] . For  the  X»2 
ffse  the  desired  trapping  probability  is  given  by 

9 

* ♦X)/^  (u+(^)  (y+X+^-yX)  ] . The  rate  ^ can  then  be 
detenained  from 
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Pr (overflow) 


B,  Qetermininq  the  rates  g and  g* 

Tbe  parameters  and  are  the  mean  pareuneters 

associated  with  the  exponential  busy  period  distribution  tails 
of  an  M/M/l/X  queue  with  arrival  rate  X and  meam  service 
times  and  respectively.  These  parameters  are  used 

to  describe  the  remaining  busy  period  of  the  buffer  at  node 
B when  the  exact  stage  of  the  buffer  is  not  known.  The  use 
of  this  parameter  comes  from  a theorem  for  first  passage 
times  that  is  given  in  Appendix  B.  The  theorem  states  that 
for  queues  such  as  the  M/M/l/X  queues  considered  here 


lim  ('t+T|>t)  • 1-e 

t**  ** 


T>0 

a>0 


Where  f..  (-t'*-T|>t)  » Pr  {first  passage  from  state  i to  k 

^ occurs  in  time  ^t+T| first  passage 

time  >t} 


The  first  passage  times  being  considered  here  are. busy 
periods « i.e.,  the  first  passage  time  from  having  one 
customer  in  the  queue  to  the  all  empty  state.  The  above 
result  states  if  that  all  that  is  known  is  that  the  busy 
period  has  been  in  progress  for  a long  time,  then  the 
conditional  distribution  of  the  time  remaining  in  the  busy 
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period  is  exponential  with  parameter  a.  It  is  natural  to 
use  the  mean  of  this  distribution  as  the  mean  time  remaining 
in  a busy  period  of  node  B,  given  that  all  that  is  known  is 
that  a busy  period  is  in  progress.  Appendix  B outlines  the 
derivation  of  the  parameter  a.  For  the  X«2  examples,  a was 
determined  by  actually  finding  the  Laplace  transform  of  the 
busy  period  distribution  for  an  M/M/l/X  queue  using  the 
techniques  in  Section  2.1.2.  The  parameter  a is  then  the 
pole  of  the  transform  that  is  closest  to  the  origin.  For 
an  M/M/l/X  queue  with  X«2  and  peurameters  X and  u. 


,-(2u+X)  + /(2u+X)^-4u 

[ j 


C*  Determining  the  parameter  n 

The  parameter  n is  used  to  approximate  the  effect  of 
multiple  overflows  in  a busy  period.  Once  the  system  is  in 
state  it  has  already  had  at  least  one  overflow  in 

the  current  busy  period  and  may  have  another.  To  account  for 
this,  the  probability  of  going  directly  from  state 
to  state  (1,0}  is  equated  with  a lower  bound  on  the  probab> 
ility  of  having  another  overflow  in  the  busy  period  of  buffer 
C,  given  that  there  has  already  been  at  least  one  in  this 
busy  period.  The  probability  of  going  from  state  {111,0}  to 
(1,0}  is  n/(n*^X)  and  the  lower  bound  that  is  used  is 

A 

1-Pr (overflow  again | at  least  one  overflow)  where  the  later 
is  given  by  Equation  2.25. 
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All  tr2msition  rates  for  the  Markov  chain  in  Figure  4.10 
have  now  been  specified.  The  remaining  problem  is  to  find 
the  steady  state  occupancy  probabilities  for  the  chain.  Let 
X(t)  be  the  state  of  the  system  at  time  t-0.  Then  the 
desired  occup2mcy  probabilities  are 

If.  • lim  IT . (t)  ■ lim  Pr{x(t)«j} 

J t***  ^ t"**® 

These  can  be  found  by  first  solving  for  the  occupancy 
probabilities  in  the  imbedded  discrete  time  Markov  chain. 

The  imbedded  chain  has  one  step  transition  probabilities 
that  are  equal  to  those  in  the  original  chain.  The 
difference  is  that  all  one  step  transitions  occur  in  one 
discrete  time  unit.  Let  P*  be  the  one  step  transition 
probability  matrix  for  the  imbedded  chain  with  elements 
p^j  ■ Pr (x* (n+l)“j |x' (n)«i)  n»0,l,2...  where  x' (n)  is 

the  state  of  the  imbedded  chain.  Then  the  relationship 
between  the  imbedded  chain  and  the  original  is  that 

p!.  ■ Pr(next  state  is  j starting  state  is  i in  the 

original  chain) 


These  probabilities  are  given  in  the  illustration  of  the 
imbedded  chain  in  Figure  4.13.  Let  iT|(n)  » Pr(x'{n)«i) 


and  Il!"lim  Ill(n).  Then  the  result  that  TT'  • ir'F’  can  be 


used  to  find  the  vector  of 
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• • d • X+y/2+5  g - y+2X 

^ • • u/2+C  h • w+X 

0 • 5’>x  f • n+x 


fWURE  4.13  - Imbedded  Markov  chain  for  the  chain  shovm  in 
i^i^fure  4.11.  Transition  probabilities  are 
shown  on  the  diagram. 
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Now  the  occupancy  probabilities  for  the  original  chain 


can  be  found  from  n ' . Each  state  i in  the  original  chain 

has  a mean  holding  time  T.  - [E  r. where  the  r. .'s 

^ all  j 

are  the  transition  rates  from  state  i to  j given  in  Figxire 
4*10.  The  holding  time  is  the  time  from  entering  a state 
until  the  first  transition  out  of  the  state  [HOWD  64]. 
Finally  the  following  relationship  can  be  used 


n’  T 


I IT'  T 
all  j J 


i 


{HOWD  64] . The  above  states  that  the  occupancy  probabilities 

in  the  original  chain  are  equal  to  those  in  the  imbedded 

chain  weighted  by  the  mean  holding  times  of  the  states. 

This  completes  the  analysis  of  the  approximating  chain. 

The  question  now  is  how  well  this  chain  predicts  the  pro- 
% 

bability  of  overflow  at  the  stage  1 nodes.  The  approximations 
uaed  in  .this  section  have  all  been  made  in  such  a way  that  the 
chain  should  give  a probability  of  overflow  that  is  greater 
than  the  actual  probability.  The  next  section  presents  an 
example  and  simulation  results  that  confirm  this. 
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4.2.2  An  exeunple  and  simulation  verification 

Th«  exeunple  to  be  considered  has  2 buffers  at  each 
stage  1 node  {X*2) , The  mean  length  of  messages  is 
and  ^e  maxinum  rate  for  all  communication  channels  is  1. 

The  buffer  at  stage  2 can  hold  exactly  three  messages  each 
of  length  1, 

The  probability  of  overflow  at  stage  1 predicted  by  the 
fPProximating  chain  is  shown  in  Figure  4.14  for  different 
arrival  rates  X . Also  given  are  the  results  of  a Monti 
§arlo  computer  simulation  for  each  of  the  cases.  The 
simulation  techniques  were  similar  to  those  in  Section  3.1.4. 
The  simulation  results  indicate  that  the  approximating  chain 
|.ndeed  consistantly  gives  a larger  probability  of  overflow. 

^ indication  of  how  settled  the  simulation  results  are 
is  given  in  Figure  4.15.  Here  the  probability  of  overflow  is 
plotted  as  a function  of  the  length  of  the  simulation  run. 

?he  conclusion  is  ttat  the  approximate  analysis  presented 
hsre  is  indeed  useful  for  obtaining  conservative  estimates 
fpr  ^e  probability  of  overflow  when  there  is  coupling 
^fbween  stages  of  the  concentration  tree  due  to  flow  control. 


\ Approximating  chain 
calculation 


Srobability  of 


O Simulation  result 


Arrival  rate  X 


FIGURE  4.14  r Probability  of  overflow  for  the  concentration 
-tree.  x«2,  u ^"1,  buffer  size  at  stage  2 is  3 
end  C>1. 
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.15  - Simulation  data  for  result  shown  in  Figure  4.14. 
Arrival  rate  X ■ 0.25. 
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C^TER  V = CONCLUSION  AND  SUGGESTIONS  FOR  FURTHER  RESEARCH 

5.1  Conclusion 

fUs  study  has  developed  and  used  the  gradual  input  queue 
Bodel  due  to  Rubinovitch,  Cohen  and  Kaspi  to  investigate 
buffering  and  flow  control  in  message  switched  communication 
networks.  The  model  as  presented  here  has  two  major  applica- 
tions t The  first  is  to  show  the  behavior  of  a flow-through 
t^e  of  network  operation.  In  the  gradual  input  model, 
messages  are  not  stored  before  being  forwarded  to  the  next 
node  if  there  is  no  waiting  line  when  the  message  arrives, 
gince  the  M/M/1  model  represents  store  and  forward  operation, 
the  comparisons  between  the  gradual  input  model  and  the  M/M/1 
model  provide  a comparison  between  flow-through  operation 
4nd  store  and  forward  operation.  The  results  throughout  the 
thesis  show  that  t^e  flow-through  operation  gives  less 
queueing  and  therefore  also  a lower  delay  in  the  network. 

7hs  differences  can  be  significant  if  the  network  contains 
Ion?  chains  of  nodes  with  little  cross  traffic  at  each  node. 

In  tl^is  situation,  the  flow-through  model  allows  the  path 
OVt?  nany  individual  links  to  become  essentially  one  link 
when  there  are  no  waiting  lines  at  intermediate  nodes.  The 
fxpaeted  delay  over  this  path  therefore  approaches  the  time 
%e  transmit  over  one  link.  In  store  and  forward  operation 
^e  delay  is  always  at  least  as  large  as  the  siun  of  the 
4ndividual  transmission  times  over  each  link  in  the  path. 
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Sine*  flow-through  operation  appears  to  have  theoretical 


f 

I 

I 

t^vantages  over  store  and  forward  operation,  a logical 
(^U^stion  is  why  it  is  currently  not  being  used.  One  major 
reason  is  that  it  does  not  allow  the  use  of  standard  link  by 
link  protocols.  The  link  by  link  protocols  permit  error 
detection  and  retransmission  on  each  link.  Only  end  to  end 
error  protection  can  be  used  in  a flow-through  network.  End 
to  end  error  protection  allows  errors  to  be  passed  from  one 
link  to  another  in  the  network.  This  makes  it  difficult  to 
guarantee  correct  network  operation  since  control  information 
as  well  as  user  data  is  sent  through  the  network.  For  example, 
I if  an  error  occurs  in  the  address  of  a message,  it  may  not 

reach  the  correct  destination  node. 

A second  major  reason  that  store  and  forward  operation  is 
being  used  is  that  it  allows  for  a straightforward  node 
architecture.  The  tasks  associated  with  receiving  a message 
over  one  link  are  all  completed  and  the  message  is  stored  in 
memory  before  a request  for  further  transmission  is  acted  on 
by  the  node  processor.  In  order  to  achieve  flow-through 
operation,  reception  and  transmission  of  a message  must  be 
occurring  at  the  same  time.  Though  no  such  system  has  been 
built,  this  could  conceptually  be  done  with  only  a slight 
delay  for  switching.  A delay  for  switching  is  necessary 
because  the  node  must  have  time  to  determine  routings  and 
to  recognize  the  ends  of  messages.  The  delay  needed  could  be 
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provided  by  a shift  register  as  illustrated  in  Figure  5.1. 

Bere  it  is  assumed  that  the  nodes  send  a continuous  string 
of  O's  over  channels  unless  a message  is  to  be  sent.  A 
message  always  starts  with  a 1 followed  by  the  destination 
address.  The  end  of  the  message  is  marked  by  a unique 
sequence  of  bit^.  As  shown  in  Figure  5.1,  the  first  positions 
of  the  shift  register  are  used  to  read  destination  addresses 
and  detect  the  ends  of  messages.  The  last  portion  of  the  shift 
register  is  used  to  introduce  enough  delay  to  allow  the  switch 
time  to  operate. 

The  second  major  application  of  the  gradual  input  model 
i*  the  identification  of  the  effects  of  having  a finite 
number  of  input  channels  to  a network  node.  In  Chapters  2 
and  3 it  was  shown  that  there  are  several  such  effects. 

These  effects  will  occur  even  if  the  network  is  operating  in 
a store  and  forward  fashion.  Therefore,  in  designing  a 
network,  the  gradual  input  model  can  be  used  to  determine 
if  there  are  any  nodes  at  which  there  are  significant  effects 
due  to  a finite  nu’.nber  of  inputs. 

The  chapter  on  flow  control  in  concentration  tree 
structxires  addressed  the  problem  of  buffer  allocation  to 
achieve  minimum  probability  of  buffer  overflow  while  using 
flow  control.  It  was  shown  that  in  certain  cases  it  is 
optimal  to  place  all  buffers  at  source  nodes.  However, 
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FIGURE  S.l  ? Shift  r«gist«r  used  in  a flow-through  node 
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^«re  are  also  cases  where  this  is  not  so  and  an  example 
wes  presented  that  gave  insight  into  the  reason  for  this. 


Suggestions  for  Further  Research 

It  has  been  shown  that  the  effects  of  a finite  number 
of  input  sources  to  a node  can  be  important.  Therefore,  for 
engineering  purposes,  it  would  be  useful  to  develop  a model 
of  store  and  forward  operation  with  a finite  number  of  inputs. 
Zt  would  be  particularly  useful  if  the  model  included  details 
of  node  operation  as  done  by  Lam  [LA.M  76] . 

The  routing  problem  for  a network  of  gradual  input 
queues  has  been  only  briefly  discussed.  It  remains  an  area 
for  future  work. 

Only  one  type  of  flow  control  has  been  studied  in  this 
work.  Flow  control  in  a concentration  tree  with  a global 
controller  is  the  only  type  considered.  There  is  still  much 
work  to  be  done  in  the  area  of  flow  control  for  general 
sietworks, 

Finslly,  it  was  shown  that  for  certain  concentration 
trees  it  is  optimal  to  place  all  buffers  at  source  nodes.  An 
open  question  is  whether  there  are  any  more  general  networks 
for  which  such  a result  is  also  true.  Clearly,  one  such  net~ 
work  is  a star  network  in  which  the  central  node  is  used  only 
for  switching.  This  is  a straightforward  extension  of  a tree. 
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There  may  be  others  as  well.  Such  networks  would  have  no 
internal  network  buffers  and  therefore  it  may  be  possible 
to  find  myopic  flow  rules  for  the  network  that  are  optimal. 
This  would  be  a step  forward  in  the  understanding  of  the 
optimal  dynamic  operation  of  a communication  network. 


APPENDIX  A - RESULTS  FOR  THE  GRADUAL  INPUT  QUEUE  WITH  NON- 
IDENTICAL INPUT  CHANNELS 

Kaspi  and  Rubinovitch  [KASPI  75]  have  derived  results 
that  allow  one  to  analyze  a gradual  input  queue  with  non- 
identical input  channels.  Each  input  channel  is  still  des- 
cribed by  an  alternating  renewal  process  as  depicted  in 
Figure  2.1b.  The  idle  periods  on  the  jth  channel, 
restricted  to  being  exponentially  distributed,  i.e. 

Pr(T^j  - x)  » l-e“^j*  x>0;  Xj>0 

The  active  periods  on  the  jth  channel,  c^j/  are  allowed  to 
have  a general  distribution,  i.e. 

PrCcij  < x)  « (x)  x>0 

Previously,  in  the  Cohen  analysis,  it  was  required  that  each 
Bj  (x)  > B(x)  and  that  all  Xj*X.  As  before,  the  behavior  of 
the  buffer  is  analyzed  by  making  an  analogy  with  an  M/G/1 
queue.  In  order  to  make  the  desired  analogy,  one  must  again 
be  able  to  obtain  the  distribution  of  the  quantity  h-£  for  an 
inflow  period  and  the  distribution  of  the  busy  period  on  the 
output  channel. 
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Distribution  of  h-t  for  an  Inflow  Period 
For  toe  jth  input  channel  let 

- /*  t dB . (t) 

5 t-0  J 

Vi  (P)  ■ /*  dB.  (t) 

3 t.«0  J 


Then  the  following  relationship  holds  (Equation  3.3  in  (KASPI 

75J). 


Ay  * AyE{exp(-ph  - sji)}}"^’ 


-i.  N 
9 


1 

2;t 


exp (Ujt)du^ 


’ij+Aj-AjB*j  (p+Uj) 


•}  dt  (Eq.A.l) 


N 

vbere  Am  * Z Aj#  Be  s>0/  Re  p"0/  Re  u*>0. 

^ 4*1  ^ ^ 

Prom  Equation  A.l,  the  first  moments  of  h and  i can  be 
obtained.  These  are 


N 


m)  - 

{?  AiS,  (1+Au6i)}/Am 

(Eq.A.2) 

* 

N 

* 

^4-1 

(Eq.A.3) 

The  theorem  due  to  Cohen  which  states  that  the  maximum  buffer 
content,  during  a busy  cycle  for  the  gradual  input 

queue  is  toe  same  as  the  m2ucimum  virtual  waiting  time  v 

indx 

of  an  M/G/1  queue  with  a service  time  distribution  identical 
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to  that  of  h-£  and  mean  interarrival  time  can  now  be 

T 


applied.  By  using  Equation  2.4,  this  yields  the  relationship 

log(l-X^ECh-i})  X^E{h-i}<l 

Together  with  Equations  A. 2 and  A. 3,  this  provides  a closed 

form  expression  for  E{C  _ }. 

max 

B.  Distribution  of  the  Busy  Period  on  the  Output  Channel 
For  a gradual  input  queue  with  identical  inputs , the 
distribution  of  the  busy  period  on  the  output  channel  is  the 
same  as  the  busy  period  of  an  equivalent  M/G/1  queue. 
Specifically,  Rubinovitch  [RUBIN  73]  showed  that  when 
Bj (x)  *‘B(x)  and  Xj*X  for  all  input  channels  j,  the  Laplace 
Stieltjes  Transform  (LST) , D*(p),  of  the  distribution  of  the 
length  of  the  busy  period,  b,  is  given  by  the  functional 
equation 

% 

D*(p)  «B*((N-1)X  + p -(N-l)XD*(p) ) Re  p>0 

For  the  case  of  non-identical  inputs,  let  (p)  be  the  LST 
of  the  distribution  of  the  length  of  a busy  period  started 
by  the  jth  input  channel  coming  on.  Then  the  following 
theorem  gives  the  desired  result  for  this  case. 

Theorem  [KASPI  75] 

(i)  The  LST's  D*j(p),  1-j-N,  are  the  unique  solution  to 
the  system  of  functional  equations 
D*.(p)  ■ B* . (p  + Z X.  - Z X.D*,(p))  Re  p>0 

^ J i^j  ^ i^j  ^ ^ 
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(ii)  p*(p)  is  given  by 


► 

B*(P)  Z X.B*.(P  + r 2 X.D*.  (p)) 

• i>?l  ^ ^ ^ ^ ^ 

N 

(iii)  Let  o.  ■ X.S--  and  F ■ E a./(l+a.) 

- 1 i ?■  i-1  ^ ^ 

^en  if  r < 1 

E{b}  - r/{X^(l  -F)} 

iRd  if  F ^ 1 
E{b}  » » 
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^PENDIX  B --  A LIMIT  THEOREM  FOR  FIRST  PASSAGE  TIME 
BISTRIBUTIONSt 

First  passage  time  distributions  for  queues  which  can  be 
represfented  by  a Markov  chain  are  investigated  in  this  appen- 
dix, It  is  shown  that  the  tail  behavior  of  such  distributions 
is  either  geometric  or  exponential  (depending  on  whether  a 
discrete  or  continuous  time  example  is  being  considered) . 

This  result  provides  insight  into  the  dynamics  of  queue 
pperatipn  and  can  be  used  to  approxim.ate  first  passage  time 
distributions . 

A,  A Preliminary  Lemm.a 

The  proof  of  the  main  theorem  in  this  appendix  depends 
on  the  lemma  that  follows.  The  lemma  applies  to  Markov 
qhains  with  either  a finite  or  countably  infinite  number  of 
states,  The  state  of  the  system  at  time  t will  be  denoted  by 
x(t)  ■ i (i  * 1*2,3, , . . ) , State  occupancy  probabilities  will 
^e  denoted  by 

11^  (t)  « Pr(x(t)  » i)  t - 0 

fTOXs'  appendix  is  part  of  the  paper;  "A  Note  on  the  Chernoff 
Bound  and  a Limit  Theorem  for  First  Passage  Time  Distributions 
of  Queues",  by  E.F.  VJunderlich  and  P.A.  Kumblet,  M.I.T. 
Eiectronic  Systems  Laboratory,  ESL-P-728,  March  1977. 
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Only  homogeneous  Markov  chains  are  considered  and  state 
transition  probabilities  are  given  by 


(t)  « Pr(x(t)  » j I x(0)  » i)  t >0 

For  such  a chain,  the  first  passage  time  T^(i,j)  is  by 
definition 

4nf{T|;  x(T^)  » j [ x(0)  » i} 

The  first  passage  time  quantities  that  will  be  of  interest 
ere 

f^^ (*  t)  » Pr(T^(i,j)  - t) 

I > t^)  » Pr(Tj(i,  j)-t2lTj{i,j)>tj_) 


I.enima;  Consider  an  irreducible  Markov  chain.  Modify  the 
chain  by  making  state  k a trapping  state,  i.e.  ■ 1 for 

all  If  for  the  modified  chain 

Pi"*  < < 

lia  Tij  * c.  O-c.-l  for  all  jy^k 

then  for  both  the  original  and  the  modified  chain 


j 
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IT 

Ita  + T I > tj)  - 1 - t-  1,2,3... 

1 - e”*^  T > 0 

1 > b > 0;  a > 0 

depending  on  whether  the  time  index  of  the  chain  is  discrete 
or  continuous.  The  variables  b and  a may  depend  on  the 
states  i and  k. 

Proof:  Consider  the  following  two  probabilities 

I >tj^)  and  f^j^  (-tj^+T+d  I >tj^+d)  where  t>0;  d>0. 

The  first  passage  time  from  state  i to  k in  the  original 
Markov  chain  is  the  same  as  the  time  until  trapping  in  state 
k/  starting ^from  i,  in  the  modified  Markov  chain.  Therefore, 
the  above  can  be  written  as 

^ik  ^-ti+T(x(tj^)«j) 

Pr  (x  (tj^)»j  I first  passage 
time  >tj^) 

Z Pr(x(t,  )«j  [first  passage 

all  states  j ^ ^ 

♦xcept  j ■ k time  >t^) 


^Ik  * ^^l’ 


all  -states  j 
except  j ■ k 
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ftll  states  j 
fxcept  j ■ 


Inhere  refer  to  the  modified  chain. 

Similarly 


f.v{-(t,+d)+T|>t,+d)  - I 

^ * all  states  j 

except  j » Ic 


jk'  i-Pik^v^) 


How  recall  that  lira  -r—^ — 7T~r  * note  also  that 

Pi4  (t,M) 

lira  1 ^ var  ■ c . . Therefore  as  t,  * it  follows  that 


Pj  J Pi-4  (t.+d) 

-.*j„-.t-  ...  * -±J — V -jiT-  since  both  terms  converge  to  c . . This 
leads  to  the  result  that  as  t^^  -►  • 


fU^(-tj+T|>tj)  f^j^(-{tj^+d)+Tl>t^+d) 


(Eq.B.l) 


Therefore,  in  the  limit  as' t^  Equation  B.l  can  be 

written  in  the  form 


Pr(0  < Ty  • t)  • Pr{Tj,  - t d I > d) 


(Eq.B.2) 


where  T^  <■  remaining  time  (after  time  t^^)  until  first 
passage  from  state  i to  state  k conditioned  on  the  fact 
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that  the  first  passage  time  frame  state  i to  state  Ic  is 


greater  than  t^.  It  is  well  known  that  Equation  B.2  implies 
that  the  distribution  of  is  either  geometric  or 
exponential.  [PARE  62]. 

An  intuitive  interpretation  of  this  lemma  is  that  if 
the  distribution  of  state  occupancy  probabilities  in  the 
modified  chain,  conditioned  on  the  fact  that  the  trapping 
state  has  not  been  entered,  has  a steady  state,  then  the 
remaining  time  until  trapping  (remaining  first  passage  time) 
is  either  geometric  or  exponential.  The  following  theorem 
proves  that  this  conditional  steady  state  distribution 
exists  and  shows  how  it  can  be  found  for  a discrete  time, 
finite  state  Markov  chain. 

B.  Main  Result 

Theorem ; Consider  a discrete  time,  finite  state  Markov 
chain.  Modify  the  chain  by  making  state  k a trapping  state, 
i.e.,  • 1 for  *11  t(t»0,l,2,3. . . ) . If  in  the  modified 

system,  all  states  (except  k)  that  are  accessible  from  state 
i communicate  with  i and  are  not  periodic  and  if  state  k is 
accessible  from  state  i,  then  for  the  modified  system 

lim  c . 0 - c.  - 1 for  all  j^k 


and  lim  f (-t+r  | >t)  ■ 1-b^ 
t-*« 


T ■ 1,2,3,4...  ; 1 > b > 0 
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Proof ; The  evolution  of  state  occupancy  probabilities  for 
the  original  Markov  chain  is  given  by 

ir(t+l)  - ir(t)P  t • 0,1,2, 3 

where  ir  is  a row  vector  of  state  occupancy  probabilities  and 
P is  the  matrix  of  one  step  transition  probabilities.  [PRAZ 
62]  Similarly,  the  state  occupancy  probabilities  for  the 
modified  Markov  chain  are  given  by 


ff(t+l)  - ff(t)  P t - 0,1,2,3....  (Eq.B.3) 


where  is  nearly  identical  to  P.  P and  P differ  only  in  the 
kth  row.  In  the  kth  row  of  P,  Pj^  is  1 and  all  other  entries 
are  0.  The  initial  condition  for  the  modified  chain  is 
i^(0)  ■ 1 and  ■ 0 for  all  j ^ i.  Since  the  first 

passage  time  from  state  i to  k in  the  original  Markov  chain 
is  the  same  as  the  time  \intil  trapping  in  the  modified  chain, 
only  the  latter  will  be  considered.  From  Equation  B.3,  one 
can  express  (t+1)  as 


f j (t+1) 


Z #9<t) 
all  states 


Z ffi(t)  p 
all  states 
except  £«k 


Ij 


(ifOc) 


(Eq.B.4) 


iv(t+l)  - 2 (Eq.B.5) 

* - all  states 

except  £«k 
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Note  that  j (t+1)  (j^k)  satisfies  a recursion  equation  that 
does  not  contain  Also  note  that  ^ ^ (t)  (j^k)  will  be  0 

for  all  t for  any  state  that  does  not  communicate  with  state 
i when  one  removes  the  trapping  state  k from  the  modified 
chain.  Therefore  one  can  write 

ff(t+l)  - if(t)  P (Eq.B.6) 

where  if  is  a row  vector  of  state  occupancy  probabilities 
that  does  not  include  the  trapping  state  or  any  state  which 
does  not  communicate  with  state  i after  the  trapping  state 
is  deleted  and  is  the  matrix  P having  the  rows  and  columns 
associated  with  the  deleted  states  removed.  The  elements  of 
f are  all  non-negative;  i.e.  - 0.  Therefore  ?>o. 
Furthermore/  since  all  states  considered  in  P commxinicate 
with  state  i and  are  not  periodic,  P”'  >>  0 for  some  integer 
m > 0/  where  >>  signifies  that  all  elem.ents  of  P*”  are  > 0. 

The  following  Frobenius  Theorems  for  positive  matrices 
[KARL  75]  can  therefore  be  applied. 

Tl:  If  matrix  A > 0 and  A*"  >>  0,  for  some  integer  m > 0, 
then  (a)  there  exists  a vector  x^  >>  0 such  that  x^A^a^x*^; 

(b)  if  a Cq  is  any  other  eigenvalue  of  A,  then  |a|  <aQ.; 

(c)  the  left  eigenvectors  of  A with  eigenvalue  Qq  form  a one 
dimensional  subspace. 
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T2:  If  A > 0 and  A >>  0 for  some  integer  m > 0,  then 


=>=•  a"  B as  n • 


where  B >>  0 is  a ma^ix  of  rank  1 with  elements 

*^re  is  ^e  row  vector  given  above  and  f^  is  a column 

vector  satisfying  Af^  • which  is  normalized  by  a 

multiplicative  factor  so  that  Z ■ 1* 

i ^ ^ 

f3:  If  A > p,  toen  the  eigenvalue  of  largest  magnitude 
Ug  .9  gg(A)/  is  real  2md  non^negative  and  if  there  exists 
a vector  x®  >>  0 such  toat  x®A  - ux*^,  then  u is  an  upper 
totod  for  Uq (A) . 

Tl  states  toat  there  is  a largest  eigenvalue  of  P and  that 
the  left  eigenvector  associated  with  it  is  unique  (to  within 
a constant) . 

{.et  r be  toe  largest  eigenvalue  of  P.  Then,  because 
f(t)  e ir(p)P^ 


iim  • lim 

ti-  r- 


if  (0)  ^ • n(0)  B 


(Eq.B.7) 


sppiyin?  72.  This  implies  that 


iaCt) 

r 5-  itj 

^ all  states  j J 


0-Cj-l  for  all  jj^k 

(Eq.B.S) 
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from  w’.ich  it  follows  that  the  previous  lemma  holds.  Equation 
.8.8  is  equivalent  to 


*ii < < 

lim  — i— ■ c . O-c.-l  for  all  j»k 

t—  l-Pijj(t)  J 3 

By  noting  that  the  vector  c of  components  ^ ^ } is  a 

scaled  version  of  if  (0)8  ■ if(0)f*^x®  it  can  be  shown  that  c is 

the  left  eigenvector  (scaled  to  have  Z c.  » 1)  of  ? that  is 

j ^ 

associated  with  the  eigenvalue  r.  T3  can  be  used  to  show 
that  r is  real  and  nonnegative.  Since  all  states  in  if  are 
transient,  the  sum  of  elements  in  at  least  one  row  of  is 
less  than  1 and  therefore  it  can  be  shown  that  r < 1. 

It  .will  now  be  shown  that  the  constant  b in  the  state- 
ment of  the  theorem  equals  r.  Recall  that  (-t+r  | >t)  « 
^jj(t+T)  if  ifj^(t)  « 0.  If  ffj^(t)  » 0,  then  lim  f ^ (t)  ■ c^; 

j?0c.  Since  the  states  (j?^k)  are  the  same  as  those  in  the 
% 

ifj  system,  one  can  apply  the  equation 
if(t  + 1)  - Tf(t)  ? 

Noting  again  that  the  vector  c is  the  left  eigenvector  of  ? 
associated  with  the  eigenvalue  r,  it  follows  that  if 

(t)  - c^ 
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then  ffj(t+T)  ■ t • 1^2/3,... 

j ^ Jc 


Since  I.  (t+r)  * 1 - Z ffj(t+T)» 
^ jA  3 


if  ^ as  t •»■  <a 


ifj^(t+T)  ■ 1 - r"^  ■ f j^j^(t+T  I >t) 

T * lr2,3.... 


Therefore  r « b. 

C.  Extension  to  Continuous  Tine  Markov  Chains 

The  previous  theorem  applies  only  to  discrete  time 
Markov  chains.  A similar  theorem  can  be  proven  for  continuous 
time  Markov  chains  by  applying  the  Kolmogorov  differential 
equations  for  such  chains.  The  Kolmogrov  equations  for 
homogeneous  chains  are 

it  " P(t)A  and  - i P(t) 

Where  the  states  associated  with  ?(t}  are  defined  as  in  the 
previous  theorem  and  X is  a matrix  of  transition  intensities. 
[PAEZ  62]  The  initial  condition  is  ?(0)  > I and  the  solution 
to  the  equations  is  ?(t)  ■ e^^.  In  order  to  prove  the  desired 
theorem,  one  proceeds  basically  as  follows.  Let  a be  the 
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largest  eigenvalue  of  A,  It  can  be  shown  that  a <0  emd  that 
a is  an  eigenvalue  of  multiplicity  1.  Now  A can  be  expressed 
in  Jordan  normal  form  as  follows. 


From  this  it  follows  that 


J„(t)  il.(t)  < < 

lln  -=-1 - -2 - d.  0-d^-l  for  all  j 

t-***  S (t)  I IT  (t)  J J 

j 13  j 3 
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Therefore 


lira  f^^(-t+T|>t)  ■ 1 - e®^ 
e < 0;  T > 0 

by  the  leioma  given  at  the  beginning  of  this  section. 

0.  Approximation  Techniques  for  Markov  Chains 

First  passage  time  distributions  in  Markov  chains  are 
often  quite  complicated.  The  previous  theorem,  however, 
shows  that  their  tail  behavior  can  be  described  by  a simple 
one  parauneter  geometric  or  exponential  distribution.  This 
result  can  be  used  to  approximate  the  behavior  of  a queue 
that  has  a Markov  chain  representation  consisting  of  many 
states  by  a chain  which  has  only  a few  states.  For  excunple, 
consider  the  discrete  time  Markov  chain  representation  of  a 
single  server  queue  shovm  in  Figure  B.l.  The  states  of  the 
chain  are  the  number  of  customers  in  the  system.  Suppose 
that  one  is  interested  only  in  whether  or  not  the  server 
is  idle,  i.e.  whether  or  not  the  system  is  in  state  0. 

Since  detailed  information  is  desired  only  about  state  0, 
an  approximation  of  the  original  M stage  chain  by  a smaller 
chain  (like  the  three  state  chain  shown  in  Fibure  B.2}  might 
be  useful.  The  approximating  chain  shown  in  Figure  B.2  is 
an  attempt  to  use  only  two  stages  to  produce  a first  passage 
time  distribution  similar  to  the  distribution  due  to  N-1 
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Section  to  be  approximated 


FIGURE  B.l  - Markov  chain  representation  of  a single  server 
queue.  For  this  chain 

lim  f-Q(-t+T|>t)-l-r‘^  T - 1,2,3... 

t-*^  ^ 

0 < r < 1 


I : : ! 


FIGURE  B.2  > Approximating  chain  for  chain  in  Figure  B.l. 

If  p^  < r,  then  state  B gives  the  proper  tail 
behavior  for  the  first  passage  time  distribution 
from  state  1 to  state  0.  Parameters 
and  p^g  are  then  free  to  be  adjusted  (for  example 
to  try  to  equate  the  mean  time  to  go  from  state  A 
to  0 to  the  mean  time  to  go  from  state  1 to  0)  . 
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states  in  the  original  chain.  The  approximation  is  done  by 
equating  the  tail  behavior  of  the  two  distributions.  The 
parameters  and  P^q  might  then  be  chosen  to  try  to 

match  another  characteristic  of  the  approximating  distribu- 
tion (such  as  the  mean)  to  that  of  the  actual  distribution. 
Approximations  such  as  this  are  particularly  useful  when 
considering  networks  of  queues  whose  total  state  space  is 
too  large  to  handle  by  exact  analytic  techniques,  but  whose 
component  queues  can  each  be  approximated  and  then  be 
analyzed  as  one  system.  The  development  of  a theory  for 
such  approximations  is  an  area  open  for  further 
investigation . 

A final  observation  is  that  while  the  theorem  in  this 

appendix  has  been  formulated  for  a single  first  passage 

time,  it  can  be  generalized  to  consider  several  first 

passage  problems  simultaneously.  For  example,  in  a queueing 
% 

system,  one  may  be  interested  in  first  passage  times 
conditioned  on  events  such  as  a busy  period  ending  before 
a buffer  overflow  occurs.  The  tail  distributions  of  such 
first  passage  times  can  also  be  shown  to  be  geometric  or 
exponential. 


i 
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